2024-02-15T20:43:55.643 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16
2024-02-15T20:43:55.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-15T20:43:55.844 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f72e9224f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f72ea285c10>, signals=[15])
2024-02-15T20:43:55.844 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2024-02-15T20:43:55.844 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2024-02-15T20:43:55.845 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2024-02-15T20:43:55.874 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-02-15T20:43:55.875 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-02-15T20:43:55.875 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-02-15T20:43:55.908 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-02-15T20:43:55.908 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-02-15T20:43:55.908 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-02-15T20:43:55.940 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2024-02-15T20:43:55.941 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2024-02-15T20:43:55.941 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2024-02-15T20:43:55.992 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_9.stream (ID 10)
2024-02-15T20:43:56.017 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10)
2024-02-15T20:43:56.040 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 9.stream
2024-02-15T20:43:56.061 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream
2024-02-15T20:43:56.079 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10)
2024-02-15T20:43:56.090 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2024-02-15T20:43:56.134 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2024-02-15T20:43:56.136 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream
2024-02-15T20:43:56.267 INFO:teuthology.orchestra.console.smithi140:Power off
2024-02-15T20:43:56.267 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T20:43:56.288 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2024-02-15T20:43:56.288 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.302 INFO:teuthology.orchestra.console.smithi156:Power off
2024-02-15T20:43:56.303 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T20:43:56.311 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2024-02-15T20:43:56.330 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-02-15T20:43:56.330 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.352 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T20:43:56.365 INFO:teuthology.orchestra.console.smithi191:Power off
2024-02-15T20:43:56.365 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T20:43:56.379 INFO:teuthology.orchestra.console.smithi203:Power off
2024-02-15T20:43:56.379 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T20:43:56.387 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-02-15T20:43:56.387 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.401 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2024-02-15T20:43:56.402 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.412 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T20:43:56.413 INFO:teuthology.orchestra.console.smithi140:Power off completed
2024-02-15T20:43:56.424 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-02-15T20:43:56.514 INFO:teuthology.orchestra.console.smithi140:Power on
2024-02-15T20:43:56.514 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-15T20:43:56.525 INFO:teuthology.orchestra.console.smithi203:Power off completed
2024-02-15T20:43:56.536 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On
2024-02-15T20:43:56.537 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.558 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2024-02-15T20:43:56.627 INFO:teuthology.orchestra.console.smithi203:Power on
2024-02-15T20:43:56.627 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-15T20:43:56.650 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2024-02-15T20:43:56.651 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:43:56.672 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-02-15T20:44:00.356 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:00.413 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:00.465 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T20:44:00.522 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T20:44:00.560 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:00.669 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2024-02-15T20:44:00.673 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:00.782 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-02-15T20:44:04.468 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.524 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.577 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-02-15T20:44:04.633 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-15T20:44:04.669 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.678 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-02-15T20:44:04.733 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-02-15T20:44:04.778 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2024-02-15T20:44:04.779 INFO:teuthology.orchestra.console.smithi156:Power on
2024-02-15T20:44:04.779 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-15T20:44:04.786 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.801 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-02-15T20:44:04.801 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.824 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-02-15T20:44:04.834 INFO:teuthology.orchestra.console.smithi191:Power on
2024-02-15T20:44:04.834 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-15T20:44:04.855 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-02-15T20:44:04.855 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:04.875 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-15T20:44:04.879 INFO:teuthology.orchestra.console.smithi140:Power on completed
2024-02-15T20:44:04.895 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2024-02-15T20:44:04.980 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2024-02-15T20:44:04.996 INFO:teuthology.orchestra.console.smithi203:Power on completed
2024-02-15T20:44:05.097 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2024-02-15T20:44:08.828 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:08.876 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:08.937 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-02-15T20:44:08.985 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-15T20:44:12.943 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:12.987 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T20:44:13.083 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T20:44:13.095 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T20:44:13.184 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-02-15T20:44:13.196 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-02-15T20:44:13.285 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-02-15T20:44:13.296 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-02-15T20:46:44.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:46:44.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:46:50.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:46:50.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:46:53.820 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:46:59.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:02.460 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-15T20:47:02.876 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:47:08.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:08.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:09.116 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:47:11.516 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-15T20:47:11.932 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:47:15.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:17.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:17.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:18.175 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:47:20.572 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-15T20:47:20.988 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:47:24.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:26.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:26.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:27.228 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:47:29.628 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-15T20:47:30.044 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:47:33.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:35.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:36.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:36.284 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:47:38.684 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-02-15T20:47:39.100 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:47:42.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:44.071 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect
    server_key = t.get_remote_server_key()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2024-02-15T20:47:44.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:45.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:47:45.340 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:47:51.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:03.644 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:48:09.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:12.700 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:48:18.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:21.756 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-02-15T20:48:27.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:27.975 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-15T20:48:27.975 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-15T20:48:44.688 WARNING:teuthology.provision.fog.smithi191:timed out
2024-02-15T20:48:48.076 WARNING:teuthology.provision.fog.smithi156:timed out
2024-02-15T20:48:48.393 INFO:teuthology.provision.fog.smithi203:Node is ready
2024-02-15T20:48:48.393 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2024-02-15T20:48:48.411 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2024-02-15T20:48:48.411 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2024-02-15T20:48:48.468 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2024-02-15T20:48:48.468 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2024-02-15T20:48:48.593 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2024-02-15T20:48:48.622 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2024-02-15T20:48:48.692 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2024-02-15T20:48:48.762 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2024-02-15T20:48:48.830 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2024-02-15T20:48:48.885 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2024-02-15T20:48:48.885 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9"
2024-02-15T20:48:48.885 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2024-02-15T20:48:48.885 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2024-02-15T20:48:48.885 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-15T20:48:48.886 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-15T20:48:48.887 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2024-02-15T20:48:48.888 DEBUG:teuthology.parallel:result is None
2024-02-15T20:48:50.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:50.976 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-15T20:48:50.977 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-15T20:48:51.318 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-02-15T20:48:51.318 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-02-15T20:48:51.333 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2024-02-15T20:48:51.333 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2024-02-15T20:48:51.343 WARNING:teuthology.provision.fog.smithi140:timed out
2024-02-15T20:48:51.388 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-02-15T20:48:51.388 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-02-15T20:48:51.512 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2024-02-15T20:48:51.540 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-02-15T20:48:51.608 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2024-02-15T20:48:51.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-02-15T20:48:51.742 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-15T20:48:51.797 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-15T20:48:51.798 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-15T20:48:51.798 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-02-15T20:48:51.798 DEBUG:teuthology.parallel:result is None
2024-02-15T20:48:54.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:48:54.419 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-15T20:48:54.419 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-15T20:48:54.749 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-02-15T20:48:54.749 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-02-15T20:48:54.764 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-02-15T20:48:54.764 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-02-15T20:48:54.819 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-02-15T20:48:54.820 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-02-15T20:48:54.929 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-02-15T20:48:54.956 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-02-15T20:48:55.024 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-02-15T20:48:55.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-02-15T20:48:55.157 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-15T20:48:55.211 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-15T20:48:55.212 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-15T20:48:55.212 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-02-15T20:48:55.213 DEBUG:teuthology.parallel:result is None
2024-02-15T20:48:57.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:49:15.836 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:49:21.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:49:24.892 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:49:30.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:49:34.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:49:40.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:49:43.068 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:49:49.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:49:52.124 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:49:53.216 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-02-15T20:49:58.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:01.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:07.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:10.268 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:16.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:19.359 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:25.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:28.444 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:34.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:37.536 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:43.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:46.620 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:50:52.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:50:55.676 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:01.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:04.764 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:10.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:13.852 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:19.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:22.940 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:28.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:31.996 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:38.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:41.052 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:47.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:50.108 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:51:56.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:51:59.196 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:05.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:08.284 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:14.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:17.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:23.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:26.428 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:32.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:35.484 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:41.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:44.540 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:50.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:52:53.628 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:52:59.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:02.684 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:08.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:11.740 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:17.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:20.828 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:26.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:29.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:35.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:39.004 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:45.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:48.060 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:53:54.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:53:57.148 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:03.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:06.236 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:12.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:15.324 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:21.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:24.380 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:30.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:33.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:39.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:42.524 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:48.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:54:51.580 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:54:57.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:00.636 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:06.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:09.692 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:15.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:18.748 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:24.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:27.804 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:33.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:36.860 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:42.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:45.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:55:51.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:55:55.004 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:01.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:04.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:10.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:13.180 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:19.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:22.236 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:28.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:31.296 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:37.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:40.380 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:46.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:49.436 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:56:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:56:58.492 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:04.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:07.580 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:13.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:16.639 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:22.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:25.724 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:31.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:34.780 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:40.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:43.868 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:49.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:57:52.924 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:57:58.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:01.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:07.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:11.068 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:17.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:20.156 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:26.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:29.212 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:35.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:38.268 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:44.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:47.324 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:58:53.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:58:56.380 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:02.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:05.436 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:11.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:14.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:20.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:23.612 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:29.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:32.700 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:38.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:41.756 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:47.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:50.812 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T20:59:56.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T20:59:59.900 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:05.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:08.988 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:14.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:18.044 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:24.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:27.132 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:33.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:36.188 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:42.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:45.244 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:00:51.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:00:54.300 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:00.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:03.388 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:09.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:12.444 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:18.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:21.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:27.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:30.556 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:36.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:39.644 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:48.700 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:01:54.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:01:57.792 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:03.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:06.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:12.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:15.964 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:21.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:25.020 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:31.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:34.080 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:40.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:43.164 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:49.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:02:52.252 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:02:58.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:03:01.308 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:03:07.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:03:10.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:03:16.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-15T21:03:19.484 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2024-02-15T21:03:19.486 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2024-02-15T21:03:19.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-15T21:03:19.795 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=347ea6ba1d1f4f2b86e72fc4e18da8a8
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2024-02-15T21:03:19.797 INFO:teuthology.nuke:Checking targets against current locks
2024-02-15T21:03:19.868 DEBUG:teuthology.nuke:shortname: smithi140
2024-02-15T21:03:19.869 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-15T21:03:19.886 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-14_14:58:57-rados-wip-yuri4-testing-2024-02-13-1546-distro-default-smithi/7559879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 20:43:54.523628', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUa5qcODYFGqkPYQcPho2MJRk6OpNq8Gv5BJOPJkPZFBwwt1JxIzpMR7cZempo9VJvQlxoHh+wCI95Va21hf5s='}
2024-02-15T21:03:19.904 DEBUG:teuthology.nuke:shortname: smithi156
2024-02-15T21:03:19.905 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-15T21:03:19.931 INFO:teuthology.orchestra.console.smithi140:Power off
2024-02-15T21:03:19.931 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T21:03:19.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-14_14:58:57-rados-wip-yuri4-testing-2024-02-13-1546-distro-default-smithi/7559879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 20:43:54.527493', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWlZv2kRziOgpal0vINAzOpt2b/NPiw91LSLMShhn6GxpwBKVDlkNDcv9J65wHwLmap6CCtZ+9uR8qhcURMTnU='}
2024-02-15T21:03:19.945 DEBUG:teuthology.nuke:shortname: smithi191
2024-02-15T21:03:19.945 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-15T21:03:19.957 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2024-02-15T21:03:19.957 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:19.966 DEBUG:teuthology.nuke:shortname: smithi203
2024-02-15T21:03:19.967 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-02-15T21:03:19.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-14_14:58:57-rados-wip-yuri4-testing-2024-02-13-1546-distro-default-smithi/7559879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 20:43:54.528611', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtzL3Ze3G9koPumzisoGzEdCtwmKPs+gk0CR1/XCXC16oFJM04g3/JFjnIUeXhoH1Ukqy4S3GOGkhzQ4FN8TFk='}
2024-02-15T21:03:19.980 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2024-02-15T21:03:19.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-14_14:58:57-rados-wip-yuri4-testing-2024-02-13-1546-distro-default-smithi/7559879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 20:43:54.525770', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFerNgyoKLuOU8FbzJlTXXb0KzyrQBVuLwXEs7vzU7/yQOVWAtHGHNMXGvVBxOO/DPfP/UZ21I59+lQQdYsapkc='}
2024-02-15T21:03:20.002 INFO:teuthology.orchestra.console.smithi156:Power off
2024-02-15T21:03:20.003 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T21:03:20.027 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-02-15T21:03:20.027 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:20.050 INFO:teuthology.orchestra.console.smithi191:Power off
2024-02-15T21:03:20.050 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T21:03:20.060 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T21:03:20.073 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-02-15T21:03:20.073 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:20.087 INFO:teuthology.orchestra.console.smithi203:Power off
2024-02-15T21:03:20.088 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-15T21:03:20.102 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T21:03:20.109 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2024-02-15T21:03:20.110 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:20.133 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2024-02-15T21:03:23.984 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:24.061 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:24.095 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2024-02-15T21:03:24.103 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:24.134 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:24.171 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T21:03:24.212 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T21:03:24.245 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2024-02-15T21:03:28.100 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:28.172 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:28.213 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:28.221 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2024-02-15T21:03:28.246 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:28.283 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-02-15T21:03:28.323 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-02-15T21:03:28.359 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2024-02-15T21:03:32.224 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:32.284 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:32.323 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:32.335 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2024-02-15T21:03:32.359 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-15T21:03:32.393 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-02-15T21:03:32.434 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-02-15T21:03:32.436 INFO:teuthology.orchestra.console.smithi140:Power off completed
2024-02-15T21:03:32.468 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-02-15T21:03:32.494 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-02-15T21:03:32.534 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-02-15T21:03:32.569 INFO:teuthology.orchestra.console.smithi203:Power off completed
2024-02-15T21:03:32.585 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2024-02-15T21:03:32.643 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2024-02-15T21:03:32.676 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2024-02-15T21:03:32.710 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com
2024-02-15T21:03:33.231 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds