2023-06-21T23:44:38.080 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-21T23:44:38.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T23:44:38.082 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T23:44:52.760 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f94e8c80730>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f94e9e9e8b0>, signals=[15])
2023-06-21T23:44:52.762 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2023-06-21T23:44:52.762 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T23:44:52.762 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2023-06-21T23:44:52.786 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-06-21T23:44:52.786 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T23:44:52.786 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-06-21T23:44:52.788 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"}
2023-06-21T23:45:02.817 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"}
2023-06-21T23:45:12.854 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-21T23:45:22.698 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-21T23:45:22.732 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3)
2023-06-21T23:45:22.733 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 3}
2023-06-21T23:45:22.753 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_8.stream (ID 3)
2023-06-21T23:45:22.753 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 3}
2023-06-21T23:45:22.782 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream
2023-06-21T23:45:22.783 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:45:22.809 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream
2023-06-21T23:45:22.809 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:45:22.835 DEBUG:teuthology.provision.fog.smithi008:Canceling deploy task with ID 334445
2023-06-21T23:45:22.836 DEBUG:teuthology.provision.fog.smithi008:FOG request: DELETE /task/cancel {"id": 334445}
2023-06-21T23:45:22.857 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T23:45:22.875 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T23:45:22.893 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1}
2023-06-21T23:45:22.912 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1}
2023-06-21T23:45:22.939 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:45:22.952 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:45:26.548 INFO:teuthology.orchestra.console:Power off smithi114
2023-06-21T23:45:26.550 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T23:45:26.574 INFO:teuthology.orchestra.console:Power off smithi008
2023-06-21T23:45:26.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T23:45:26.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:26.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:26.716 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2023-06-21T23:45:26.817 INFO:teuthology.orchestra.console:Power on smithi114
2023-06-21T23:45:26.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T23:45:26.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:30.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:30.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:35.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:35.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:40.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:41.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:46.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:46.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:45:46.406 INFO:teuthology.orchestra.console:Power on for smithi114 completed
2023-06-21T23:45:46.508 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2023-06-21T23:45:46.508 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:45:51.618 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-06-21T23:45:51.718 INFO:teuthology.orchestra.console:Power on smithi008
2023-06-21T23:45:51.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T23:45:56.745 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:46:01.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:46:01.967 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2023-06-21T23:46:02.068 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2023-06-21T23:46:02.069 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:46:06.604 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:46:18.844 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:46:26.692 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:46:38.924 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:46:46.788 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:46:54.001 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:47:05.352 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:47:10.360 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:47:30.468 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:47:30.469 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:47:49.620 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:47:49.622 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:48:14.728 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-06-21T23:48:14.729 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:48:14.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:48:29.828 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None
2023-06-21T23:48:34.837 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-06-21T23:48:34.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:48:40.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:48:43.921 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-06-21T23:48:49.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:48:52.976 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-06-21T23:48:58.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:49:02.036 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-06-21T23:49:08.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:49:11.120 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-06-21T23:49:17.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:49:36.585 WARNING:teuthology.provision.fog.smithi008:timed out
2023-06-21T23:49:42.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:50:01.076 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-06-21T23:50:07.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:50:08.853 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-21T23:50:08.854 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-21T23:50:17.127 WARNING:teuthology.provision.fog.smithi114:timed out
2023-06-21T23:50:23.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:50:23.344 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-21T23:50:23.345 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-21T23:50:23.614 INFO:teuthology.provision.fog.smithi114:Node is ready
2023-06-21T23:50:23.615 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2023-06-21T23:50:23.675 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2023-06-21T23:50:23.676 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts
2023-06-21T23:50:23.736 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2023-06-21T23:50:23.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-06-21T23:50:23.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts
2023-06-21T23:50:23.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2023-06-21T23:50:23.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname
2023-06-21T23:50:24.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-06-21T23:50:24.073 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-06-21T23:50:24.131 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-21T23:50:24.132 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-06-21T23:50:24.133 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-21T23:50:24.133 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-06-21T23:50:24.133 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T23:50:24.133 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T23:50:24.133 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-21T23:50:24.134 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2023-06-21T23:50:24.135 DEBUG:teuthology.parallel:result is None
2023-06-21T23:50:24.136 INFO:teuthology.provision.fog.smithi008:Node is ready
2023-06-21T23:50:24.136 DEBUG:teuthology.orchestra.run.smithi008:> hostname
2023-06-21T23:50:24.202 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2023-06-21T23:50:24.202 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts
2023-06-21T23:50:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2023-06-21T23:50:24.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2023-06-21T23:50:24.377 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts
2023-06-21T23:50:24.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts
2023-06-21T23:50:24.477 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname
2023-06-21T23:50:24.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2023-06-21T23:50:24.616 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2023-06-21T23:50:24.674 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream"
2023-06-21T23:50:24.674 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8"
2023-06-21T23:50:24.674 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2023-06-21T23:50:24.674 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T23:50:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T23:50:24.676 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-21T23:50:24.676 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2023-06-21T23:50:24.676 DEBUG:teuthology.parallel:result is None
2023-06-21T23:51:14.861 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2023-06-21T23:51:14.862 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-21T23:51:19.891 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2023-06-21T23:51:19.892 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-21T23:51:25.091 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2023-06-21T23:51:25.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2023-06-21T23:51:25.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T23:52:04.720 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8
2023-06-21T23:52:04.721 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 327, in reimage_machines
    update_nodes(reimaged)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 38, in update_nodes
    inventory_info = remote.inventory_info
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 679, in inventory_info
    node['arch'] = self.arch
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 335, in arch
    self._arch = self.sh('uname -m').strip()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 96, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi008
2023-06-21T23:52:04.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T23:52:04.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T23:52:06.589 INFO:teuthology.nuke:Checking targets against current locks
2023-06-21T23:52:11.486 DEBUG:teuthology.nuke:shortname: smithi008
2023-06-21T23:52:11.486 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T23:52:11.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_18:12:20-rados-wip-yuri5-testing-2023-06-21-0750-distro-default-smithi/7310389', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 23:51:25.297502', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBjkyTy5Wr5n3OGzIpSztoiZgi1LRuLmSelMoUZlXaGsblo4jMXylz0DmiRqzQX2168cDbbvHlANPiME4jFb5j6cOuiLnVu8jwKlK1tIRZMwWfWRoca72y6+D/Mh7Cmo+TQoSGf5XszJM9p2SUWKxcbyUMIIbHM7XYjPt2+ZbdXgqs/KscjgoKq+sD+jUBKs3fjcr8e7niJWozmQZ/InyoAg9l2JGAhdTw415Oy13RyZXCGlf7sXOF5Ie63cDroV+EdqmPJsAFIcNQlVcb3m1+6dPrO+UshNu+F9D8FIKKWgSnD0kdJ3VEfMAk6yCuoLxrJ8nrjyZuLjeLa2ruiy50PRUuHIZZJ8HgvR23zdQhLQ1nIogSAAWOuSdN0RIcIivScmaYaMRIGpWeQDiIsnhB2W562eV2JqFAjFPcgsQOhQ3L9cpWFGgQP+JZWEVgGuQkwcYYMWHhQ4YmUddPtJ3Ud6+yBL8NNNkCCmMHxirfGmLCeCXXuQW1PyAMelsUo8='}
2023-06-21T23:52:11.536 DEBUG:teuthology.nuke:shortname: smithi114
2023-06-21T23:52:11.537 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T23:52:11.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_18:12:20-rados-wip-yuri5-testing-2023-06-21-0750-distro-default-smithi/7310379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 23:44:28.592186', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoQI4acwnhWtfVED9uDyEHBq45P8Gm6TJkbyMb5RrzhN7Mg9eTXPTdkG3x4X+ZDf3O8RClB6TEfnUfHvBglc6b7b1/PC+yNi3c10PsFiHzSoKteoo5z2bc0TMn0HKswGavLm82Zm+YCfgHFMhCYIc3O47QlcA0ebLqiZmXJZLhlHBNQSdxp2fJY13Ry4HP7XRCtOcy7BW5do7uy5JSyomHNwSEn/3fEXLTXy5jCu2IhBTVNp4hkqFhO8ettsrcIBepmlV72cGRG8drIpBvyorjSebE0YdjtCse2CBkbh1ineUxZ2sXJwuwTvaQ/eaBO4Z5FuYzr2Mv5Ol7sQJlAqG5MTdFVzcCdsbZn7wf7h6f9Ou0dCBTRdXGa0UQk0KqZOOD+imy/Z65TCYwo0mzCiiCdyuNDYGoakZJYINCHsQo1bQFj2wIJxJPL7bKSxmoj32NBiUGNQ6+qeTV+BmzYU2fZxLOf6n1tPVKMtDwpxuFFOpB9bD7N2Z82/+Ku6PU4q0='}
2023-06-21T23:52:11.570 INFO:teuthology.orchestra.console:Power off smithi008
2023-06-21T23:52:11.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T23:52:11.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:11.609 INFO:teuthology.orchestra.console:Power off smithi114
2023-06-21T23:52:11.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T23:52:11.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:11.720 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2023-06-21T23:52:11.869 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2023-06-21T23:52:15.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:19.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:24.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:30.002 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:35.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:40.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:45.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T23:52:45.554 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2023-06-21T23:52:55.714 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com
2023-06-21T23:53:03.899 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 327, in reimage_machines
    update_nodes(reimaged)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 38, in update_nodes
    inventory_info = remote.inventory_info
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 679, in inventory_info
    node['arch'] = self.arch
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 335, in arch
    self._arch = self.sh('uname -m').strip()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 96, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi008