2024-01-27T23:37:36.388 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-27T23:37:36.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:37:36.601 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f008e3ddc10>, signals=[15]) 2024-01-27T23:37:36.601 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-01-27T23:37:36.602 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-01-27T23:37:36.602 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-27T23:37:36.624 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-01-27T23:37:36.624 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-01-27T23:37:36.625 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-01-27T23:37:36.649 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-01-27T23:37:36.649 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-01-27T23:37:36.649 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-01-27T23:37:36.675 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-01-27T23:37:36.676 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-01-27T23:37:36.676 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-27T23:37:36.751 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3) 2024-01-27T23:37:36.779 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_8.stream (ID 3) 2024-01-27T23:37:36.783 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_8.stream (ID 3) 2024-01-27T23:37:36.798 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream 2024-01-27T23:37:36.821 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_8.stream (ID 3) 2024-01-27T23:37:36.824 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream 2024-01-27T23:37:36.832 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream 2024-01-27T23:37:36.868 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 8.stream 2024-01-27T23:37:37.338 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-27T23:37:37.338 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T23:37:37.361 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-27T23:37:37.361 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.383 INFO:teuthology.orchestra.console.smithi121:Power off 2024-01-27T23:37:37.383 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T23:37:37.397 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-27T23:37:37.397 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T23:37:37.409 INFO:teuthology.orchestra.console.smithi086:Power off 2024-01-27T23:37:37.409 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T23:37:37.416 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-27T23:37:37.417 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-01-27T23:37:37.417 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.424 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-27T23:37:37.424 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.432 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-01-27T23:37:37.432 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.440 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-01-27T23:37:37.444 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-27T23:37:37.452 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-27T23:37:37.518 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-27T23:37:37.541 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-01-27T23:37:37.544 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-27T23:37:37.553 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-01-27T23:37:37.618 INFO:teuthology.orchestra.console.smithi049:Power on 2024-01-27T23:37:37.619 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-27T23:37:37.642 INFO:teuthology.orchestra.console.smithi121:Power on 2024-01-27T23:37:37.643 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-27T23:37:37.649 INFO:teuthology.orchestra.console.smithi194:Power on 2024-01-27T23:37:37.649 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-27T23:37:37.657 INFO:teuthology.orchestra.console.smithi086:Power on 2024-01-27T23:37:37.657 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-27T23:37:37.663 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-01-27T23:37:37.664 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.672 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-01-27T23:37:37.673 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.679 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-01-27T23:37:37.680 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.688 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-01-27T23:37:37.688 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:37.695 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-27T23:37:37.697 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-27T23:37:37.701 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-01-27T23:37:37.710 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-27T23:37:41.698 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:41.705 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:41.712 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:41.719 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:41.808 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-27T23:37:41.815 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-27T23:37:41.821 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-01-27T23:37:41.828 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-27T23:37:41.909 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-01-27T23:37:42.010 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-01-27T23:37:45.816 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:45.822 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:45.829 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T23:37:45.924 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-27T23:37:45.930 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-01-27T23:37:45.941 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-01-27T23:37:46.025 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-01-27T23:37:46.031 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-01-27T23:37:46.042 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-01-27T23:37:46.127 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-01-27T23:37:46.132 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-01-27T23:37:46.143 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-01-27T23:40:16.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:16.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:17.354 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-27T23:40:32.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:35.136 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:40:41.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:44.188 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:40:50.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:53.244 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:40:58.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:40:59.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:01.244 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:02.300 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:41:07.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:08.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:10.300 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:11.356 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:41:16.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:17.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:19.360 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:20.412 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:41:21.357 WARNING:teuthology.provision.fog.smithi086:timed out 2024-01-27T23:41:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:26.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:27.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:28.412 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:34.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:37.468 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:43.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:44.892 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:41:45.916 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-27T23:41:46.528 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:47.239 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-01-27T23:41:50.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:51.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:52.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:41:53.948 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-27T23:41:54.332 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:41:54.972 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-01-27T23:41:55.580 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:41:59.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:00.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-27T23:42:00.173 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-27T23:42:00.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:01.222 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-27T23:42:01.222 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-27T23:42:01.408 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:42:01.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:04.636 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:42:08.444 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-01-27T23:42:10.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:11.426 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:42:13.692 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:42:19.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:21.305 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-01-27T23:42:21.306 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-01-27T23:42:21.330 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2024-01-27T23:42:21.330 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2024-01-27T23:42:21.392 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2024-01-27T23:42:21.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-01-27T23:42:21.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2024-01-27T23:42:21.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2024-01-27T23:42:21.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2024-01-27T23:42:21.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-01-27T23:42:21.766 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2024-01-27T23:42:21.826 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:42:21.827 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:42:21.828 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-01-27T23:42:21.829 DEBUG:teuthology.parallel:result is None 2024-01-27T23:42:22.748 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-27T23:42:24.444 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:42:25.471 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-01-27T23:42:25.472 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-01-27T23:42:25.497 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-01-27T23:42:25.497 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-01-27T23:42:25.558 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-01-27T23:42:25.559 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-27T23:42:25.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-01-27T23:42:25.708 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-01-27T23:42:25.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-01-27T23:42:25.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-27T23:42:25.915 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:42:25.973 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-27T23:42:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:42:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:42:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:42:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:42:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:42:25.974 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-01-27T23:42:25.975 DEBUG:teuthology.parallel:result is None 2024-01-27T23:42:28.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:42:40.461 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:42:59.479 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:43:21.496 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:43:28.752 WARNING:teuthology.provision.fog.smithi049:timed out 2024-01-27T23:43:34.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:43:35.012 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-27T23:43:35.012 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-27T23:43:35.272 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-01-27T23:43:35.273 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-01-27T23:43:35.292 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-01-27T23:43:35.292 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-01-27T23:43:35.352 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-01-27T23:43:35.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-27T23:43:35.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-01-27T23:43:35.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-01-27T23:43:35.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-01-27T23:43:35.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-27T23:43:35.689 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-27T23:43:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-01-27T23:43:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2024-01-27T23:43:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-01-27T23:43:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:43:35.748 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:43:35.749 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:43:35.750 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-01-27T23:43:35.750 DEBUG:teuthology.parallel:result is None 2024-01-27T23:43:46.513 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:44:14.530 ERROR:teuthology.orchestra.connection:Error authenticating with smithi121.front.sepia.ceph.com: BadHostKeyException('smithi121.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:95id+tJZb0eNLCpaBc6YWks5LghCngPiPT/TLEkXHss), PKey(alg=ED25519, bits=256, fp=SHA256:cGoJiNEAWpQkbfBrZOOTm96yJTUmXjRIQj2PbK5cdhI)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJ9vf1BJZVyuJ9sfTpn0wlPP9UGrq0i9IRkL7gt6rXg4' 2024-01-27T23:44:14.531 WARNING:teuthology.provision.fog.smithi121:'connect to smithi121.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-01-27T23:44:20.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:44:20.777 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-27T23:44:20.777 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-27T23:44:21.043 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-01-27T23:44:21.043 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-01-27T23:44:21.062 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-01-27T23:44:21.062 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-01-27T23:44:21.121 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-01-27T23:44:21.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-01-27T23:44:21.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-01-27T23:44:21.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-01-27T23:44:21.316 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-01-27T23:44:21.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-01-27T23:44:21.451 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:44:21.509 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-01-27T23:44:21.510 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:44:21.511 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:44:21.511 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:44:21.511 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:44:21.511 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:44:21.511 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-01-27T23:44:21.512 DEBUG:teuthology.parallel:result is None 2024-01-27T23:44:21.709 ERROR:teuthology.misc:smithi121.front.sepia.ceph.com: Connection closed by remote host 2024-01-27T23:44:21.746 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-01-27T23:44:21.747 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-27T23:44:21.775 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-01-27T23:44:21.776 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-27T23:44:21.792 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-01-27T23:44:21.792 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-27T23:44:21.808 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-01-27T23:44:21.808 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-27T23:44:21.826 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-01-27T23:44:21.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-27T23:44:21.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:44:21.900 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-27T23:44:22.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-27T23:44:22.036 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-01-27T23:44:22.095 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-01-27T23:44:22.095 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:44:22.154 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:44:22.155 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:44:22.155 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-27T23:44:22.175 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-01-27T23:44:22.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-01-27T23:44:22.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:44:22.248 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-01-27T23:44:22.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-01-27T23:44:22.322 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-01-27T23:44:22.383 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-01-27T23:44:22.383 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:44:22.444 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:44:22.445 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:44:22.445 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-01-27T23:44:22.467 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-01-27T23:44:22.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-01-27T23:44:22.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:44:22.539 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-01-27T23:44:22.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-01-27T23:44:22.607 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-01-27T23:44:22.666 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-01-27T23:44:22.666 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2024-01-27T23:44:22.725 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:44:22.726 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:44:22.727 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-01-27T23:44:22.750 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-01-27T23:44:22.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-27T23:44:22.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T23:44:22.820 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-01-27T23:44:22.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-27T23:44:22.960 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-01-27T23:44:23.019 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-01-27T23:44:23.019 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-27T23:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-01-27T23:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2024-01-27T23:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-01-27T23:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-01-27T23:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-27T23:44:23.079 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T23:44:23.079 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-27T23:44:23.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:44:23.183 INFO:teuthology.dispatcher.supervisor:Running job 7535210 2024-01-27T23:44:23.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210 --name yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi --description upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} -- /home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210/orig.config.yaml 2024-01-27T23:44:23.186 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210 2024-01-27T23:44:23.186 INFO:teuthology.dispatcher.supervisor:Job PID: 2681387 2024-01-27T23:44:23.186 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-27T23:46:23.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:48:23.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:50:23.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:52:23.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:54:23.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:56:23.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T23:58:23.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:00:23.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:02:23.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:04:23.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:06:23.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:08:23.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:10:24.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:12:24.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:14:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:16:24.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T00:16:24.346 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-28T00:16:24.503 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-28T00:16:24.503 INFO:teuthology.nuke:Checking targets against current locks 2024-01-28T00:16:24.550 DEBUG:teuthology.nuke:shortname: smithi049 2024-01-28T00:16:24.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T00:16:24.575 DEBUG:teuthology.nuke:shortname: smithi086 2024-01-28T00:16:24.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T00:16:24.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 23:37:35.308077', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4s3ivkVVYNIM0AT4mC7lBEml60cvMDjnNSwB0y5CU05a97RaWlQ0KK+LzzrjFqdO+BjLm7Huu8QvxAujkRUmo='} 2024-01-28T00:16:24.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 23:37:35.307309', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIF8t39XrEsBqiZ/Av3O9JC0HkmjLG0ddBkNfkxyhl7PoUaLIiQFoPSa3BvXIPq27leFYMeIFUO51VPNf8b9dQ='} 2024-01-28T00:16:24.605 DEBUG:teuthology.nuke:shortname: smithi121 2024-01-28T00:16:24.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T00:16:24.615 DEBUG:teuthology.nuke:shortname: smithi194 2024-01-28T00:16:24.615 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T00:16:24.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 23:37:35.305368', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGj1kPD5mfYjbYx3Jb45yCWPtPC2oc1QWirBDLuwK3wffu6kQiNunRAS4kDRCV6JQ0LTamSaHJDffjgjlkRcOQM='} 2024-01-28T00:16:24.633 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-28T00:16:24.633 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T00:16:24.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi/7535210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 23:37:35.306484', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1zGqonFMiZSmu6GfQsxSGB4KQsbAnhhkzgtMPUsdkoAoKXdI7S3t+h0iVwkmxHolZm/OOFyBgqL2NUGVfkXgY='} 2024-01-28T00:16:24.654 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-28T00:16:24.654 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T00:16:24.669 INFO:teuthology.orchestra.console.smithi086:Power off 2024-01-28T00:16:24.669 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T00:16:24.684 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-28T00:16:24.689 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-01-28T00:16:24.690 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T00:16:24.708 INFO:teuthology.orchestra.console.smithi121:Power off 2024-01-28T00:16:24.709 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T00:16:24.721 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-28T00:16:24.722 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T00:16:24.728 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-01-28T00:16:24.732 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-01-28T00:16:24.732 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T00:16:24.742 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-28T00:16:24.742 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T00:16:24.753 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-01-28T00:16:24.763 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-28T00:16:24.785 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-28T00:16:24.830 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-01-28T00:16:24.854 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-01-28T00:16:24.864 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-28T00:16:24.939 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2024-01-28T00:16:24.980 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2024-01-28T00:16:25.012 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com 2024-01-28T00:16:25.020 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com