2023-12-19T01:09:19.313 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T01:09:19.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:09:19.512 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd75a582940>, signals=[15]) 2023-12-19T01:09:19.512 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-12-19T01:09:19.513 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T01:09:19.513 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-19T01:09:19.532 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-12-19T01:09:19.533 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T01:09:19.533 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-12-19T01:09:19.548 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-12-19T01:09:19.548 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T01:09:19.548 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-19T01:09:19.573 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-12-19T01:09:19.573 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T01:09:19.573 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-19T01:09:19.928 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-19T01:09:19.935 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-19T01:09:19.939 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-19T01:09:19.942 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-19T01:09:19.970 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 22.04 2023-12-19T01:09:19.979 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of ubuntu 22.04 2023-12-19T01:09:19.986 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of ubuntu 22.04 2023-12-19T01:09:20.086 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 22.04 2023-12-19T01:09:20.205 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-19T01:09:20.205 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T01:09:20.226 INFO:teuthology.orchestra.console.smithi050:Power off 2023-12-19T01:09:20.227 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T01:09:20.238 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-19T01:09:20.238 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T01:09:20.244 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-19T01:09:20.245 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:20.256 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-12-19T01:09:20.256 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:20.265 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-19T01:09:20.265 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:20.274 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-19T01:09:20.279 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-19T01:09:20.286 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-19T01:09:20.330 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-19T01:09:20.330 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T01:09:20.351 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-19T01:09:20.351 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:20.376 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-19T01:09:24.279 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:24.287 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:24.295 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:24.378 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:24.389 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-19T01:09:24.397 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-19T01:09:24.404 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-19T01:09:24.487 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-19T01:09:28.394 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.400 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.407 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.488 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.502 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-19T01:09:28.509 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-19T01:09:28.515 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-19T01:09:28.595 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-19T01:09:28.609 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-12-19T01:09:28.696 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-19T01:09:28.710 INFO:teuthology.orchestra.console.smithi050:Power on 2023-12-19T01:09:28.710 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T01:09:28.731 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2023-12-19T01:09:28.731 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.750 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-19T01:09:28.796 INFO:teuthology.orchestra.console.smithi141:Power on 2023-12-19T01:09:28.796 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T01:09:28.816 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-12-19T01:09:28.816 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:28.834 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-19T01:09:32.507 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.515 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.617 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-19T01:09:32.625 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-19T01:09:32.719 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-19T01:09:32.726 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-19T01:09:32.751 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.820 INFO:teuthology.orchestra.console.smithi203:Power on 2023-12-19T01:09:32.820 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T01:09:32.828 INFO:teuthology.orchestra.console.smithi027:Power on 2023-12-19T01:09:32.828 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T01:09:32.835 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.845 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-12-19T01:09:32.845 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.853 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-12-19T01:09:32.854 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:32.862 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-19T01:09:32.867 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-19T01:09:32.876 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-19T01:09:32.945 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-19T01:09:36.865 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:36.872 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:36.877 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:36.946 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:36.974 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-19T01:09:36.979 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-12-19T01:09:36.985 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-19T01:09:37.054 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-19T01:09:37.075 INFO:teuthology.orchestra.console.smithi050:Power on completed 2023-12-19T01:09:37.080 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-12-19T01:09:37.155 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-12-19T01:09:37.176 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-12-19T01:09:37.180 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-12-19T01:09:37.256 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-12-19T01:09:40.986 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T01:09:41.095 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-19T01:09:41.196 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-12-19T01:09:41.297 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-12-19T01:12:53.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:12:53.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:08.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:11.954 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-19T01:13:11.954 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-19T01:13:17.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:17.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:21.009 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-19T01:13:21.010 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-19T01:13:26.801 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:13:27.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:27.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:30.065 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-19T01:13:30.066 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-19T01:13:32.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:35.857 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:13:36.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:36.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:39.121 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-19T01:13:41.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:42.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:44.913 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:13:45.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:50.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:13:53.969 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:13:59.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:03.025 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:14:09.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:36.071 WARNING:teuthology.provision.fog.smithi050:timed out 2023-12-19T01:14:40.530 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:14:42.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:42.074 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-19T01:14:42.620 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 427, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 879, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2023-12-19T01:14:45.125 WARNING:teuthology.provision.fog.smithi141:timed out 2023-12-19T01:14:46.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:46.533 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:14:48.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:48.239 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T01:14:48.239 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T01:14:48.687 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-12-19T01:14:48.688 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-12-19T01:14:48.736 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-12-19T01:14:48.736 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-12-19T01:14:48.784 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-12-19T01:14:48.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-12-19T01:14:48.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-12-19T01:14:48.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-12-19T01:14:48.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-12-19T01:14:49.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-12-19T01:14:49.096 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:14:49.144 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:14:49.145 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:14:49.145 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:14:49.145 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-12-19T01:14:49.147 DEBUG:teuthology.parallel:result is None 2023-12-19T01:14:49.681 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:14:51.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:51.330 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T01:14:51.330 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T01:14:51.766 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-12-19T01:14:51.767 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-12-19T01:14:51.813 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-12-19T01:14:51.813 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-12-19T01:14:51.861 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-12-19T01:14:51.861 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-19T01:14:51.993 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-12-19T01:14:52.007 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-12-19T01:14:52.060 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-12-19T01:14:52.117 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-19T01:14:52.171 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04" 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-12-19T01:14:52.221 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:14:52.222 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:14:52.222 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:14:52.222 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:14:52.222 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:14:52.222 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-12-19T01:14:52.223 DEBUG:teuthology.parallel:result is None 2023-12-19T01:14:52.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:52.537 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:14:55.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:58.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:14:58.540 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:14:58.737 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:15:04.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:04.545 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-12-19T01:15:04.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:05.617 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:15:10.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:10.974 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T01:15:10.974 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T01:15:11.441 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-12-19T01:15:11.441 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-12-19T01:15:11.489 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-12-19T01:15:11.490 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-12-19T01:15:11.538 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-12-19T01:15:11.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-19T01:15:11.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:11.678 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-12-19T01:15:11.691 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-12-19T01:15:11.746 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-12-19T01:15:11.805 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-12-19T01:15:11.864 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-12-19T01:15:11.909 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-12-19T01:15:11.910 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:15:11.910 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:15:11.910 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:15:11.910 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:15:11.910 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:15:11.910 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-12-19T01:15:11.910 DEBUG:teuthology.parallel:result is None 2023-12-19T01:15:12.273 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:15:18.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:18.929 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:15:24.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:15:25.585 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:15:31.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:08.850 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-12-19T01:16:31.615 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-19T01:16:37.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:37.625 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-19T01:16:43.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:43.802 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T01:16:43.802 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T01:16:44.255 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-12-19T01:16:44.255 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-12-19T01:16:44.304 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-12-19T01:16:44.305 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-12-19T01:16:44.353 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-12-19T01:16:44.353 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-19T01:16:44.481 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-12-19T01:16:44.497 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-12-19T01:16:44.557 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-12-19T01:16:44.613 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-19T01:16:44.669 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-19T01:16:44.717 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:16:44.717 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-12-19T01:16:44.717 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:16:44.718 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:16:44.718 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-12-19T01:16:44.719 DEBUG:teuthology.parallel:result is None 2023-12-19T01:16:45.033 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-12-19T01:16:45.034 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T01:16:45.066 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-12-19T01:16:45.067 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T01:16:45.083 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-12-19T01:16:45.083 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T01:16:45.102 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-12-19T01:16:45.102 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T01:16:45.128 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-12-19T01:16:45.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-19T01:16:45.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:45.204 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-19T01:16:45.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-19T01:16:45.313 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-12-19T01:16:45.360 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-12-19T01:16:45.361 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-19T01:16:45.408 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:16:45.408 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2023-12-19T01:16:45.408 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04" 2023-12-19T01:16:45.408 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:16:45.409 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:16:45.409 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-19T01:16:45.435 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-12-19T01:16:45.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-19T01:16:45.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:45.514 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-19T01:16:45.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-19T01:16:45.734 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-12-19T01:16:45.781 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-12-19T01:16:45.782 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-12-19T01:16:45.829 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:16:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:16:45.830 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-12-19T01:16:45.860 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-12-19T01:16:45.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-19T01:16:45.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:45.936 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-12-19T01:16:46.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-19T01:16:46.162 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-12-19T01:16:46.207 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-12-19T01:16:46.207 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-19T01:16:46.259 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:16:46.259 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:16:46.260 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:16:46.261 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-19T01:16:46.286 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-12-19T01:16:46.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-19T01:16:46.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T01:16:46.360 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-12-19T01:16:46.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-12-19T01:16:46.570 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-12-19T01:16:46.616 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-12-19T01:16:46.617 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-12-19T01:16:46.664 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T01:16:46.664 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-12-19T01:16:46.664 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-12-19T01:16:46.664 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T01:16:46.665 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-12-19T01:16:46.666 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-12-19T01:16:46.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:16:46.782 INFO:teuthology.dispatcher.supervisor:Running job 7495645 2023-12-19T01:16:46.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_smanjara@teuthology --archive /home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645 --name smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645/orig.config.yaml 2023-12-19T01:16:46.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645 2023-12-19T01:16:46.786 INFO:teuthology.dispatcher.supervisor:Job PID: 1752513 2023-12-19T01:16:46.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T01:18:46.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:20:47.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:22:47.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:24:47.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:26:47.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:28:47.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:30:47.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:32:48.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:34:48.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:36:48.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:38:48.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:40:48.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:42:48.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:44:48.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:46:49.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:48:49.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:50:49.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:52:49.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:54:49.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:56:49.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T01:58:50.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:00:50.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:02:50.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:04:50.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:06:50.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:08:50.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:10:51.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:12:51.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:14:51.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:16:51.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:18:51.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:20:52.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:22:52.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:24:52.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:26:52.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:28:52.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:30:53.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:32:53.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:34:53.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:36:53.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:38:53.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:40:54.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:42:54.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:44:54.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:46:54.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:48:54.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:50:55.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:52:55.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:54:55.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:56:55.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T02:58:55.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:00:56.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:02:56.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:04:56.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:06:56.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:08:56.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:10:56.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:12:56.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:14:57.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:16:57.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:18:57.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:20:57.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:22:57.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:24:57.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:26:58.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:28:58.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:30:58.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:32:58.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:34:58.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:36:58.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T03:36:58.931 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T03:36:59.154 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T03:36:59.154 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T03:36:59.199 DEBUG:teuthology.nuke:shortname: smithi027 2023-12-19T03:36:59.200 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T03:36:59.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 01:09:18.470398', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSDTjhjIsggMHHpe/P4+tbiDIWeOSUfn+c1F4cin6K7MsYgDP+z+a4nlXGGdzg4zjNrvC1t3s2m0VfDPinE5IE='} 2023-12-19T03:36:59.237 DEBUG:teuthology.nuke:shortname: smithi050 2023-12-19T03:36:59.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T03:36:59.257 DEBUG:teuthology.nuke:shortname: smithi141 2023-12-19T03:36:59.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T03:36:59.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 01:09:18.472548', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqoK6TwV3sIHm5TK7iM+nfob/fbHueolYtHsbOfiPQe9rvzDsUfL9rFbcB68gzaRXbi2ulyBpk18tq+l3mKEQg='} 2023-12-19T03:36:59.275 DEBUG:teuthology.nuke:shortname: smithi203 2023-12-19T03:36:59.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T03:36:59.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 01:09:18.474200', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeyaaxtdi+NA+8GTXVhUVVtEkVA4vSNQr84H5okR9507sx/kSzIeRjYCbLWYgB9cIuicBhPMTosnMpi9cF1n7A='} 2023-12-19T03:36:59.291 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-19T03:36:59.292 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T03:36:59.300 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-19_01:09:08-rgw:multisite-wip-shilpa-test-wo-sync-policy-distro-default-smithi/7495645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 01:09:18.475710', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfenME8DP5D3sYUL0NZ5EdDUmVeyPPKIEIG+xXPk98dyo6O+VKT10xaeOL8Nc5IwD5MtpNadRP2N7fdGoPyc6Q='} 2023-12-19T03:36:59.308 INFO:teuthology.orchestra.console.smithi050:Power off 2023-12-19T03:36:59.308 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T03:36:59.319 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-19T03:36:59.319 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T03:36:59.328 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-12-19T03:36:59.328 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T03:36:59.339 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-19T03:36:59.345 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-19T03:36:59.345 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T03:36:59.353 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-19T03:36:59.360 INFO:teuthology.orchestra.console.smithi203:Power off 2023-12-19T03:36:59.360 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T03:36:59.366 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-19T03:36:59.367 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T03:36:59.379 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-12-19T03:36:59.379 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T03:36:59.388 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-19T03:36:59.402 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-12-19T03:36:59.440 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-19T03:36:59.454 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-12-19T03:36:59.489 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-19T03:36:59.503 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-12-19T03:36:59.588 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-12-19T03:36:59.597 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-12-19T03:36:59.630 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2023-12-19T03:36:59.646 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com