2023-07-14T02:58:08.008 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T02:58:08.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T02:58:08.011 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T02:58:33.189 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc58b5548b0>, signals=[15]) 2023-07-14T02:58:33.190 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-07-14T02:58:33.191 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T02:58:33.191 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-07-14T02:58:38.213 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-07-14T02:58:38.213 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T02:58:38.214 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-14T02:58:38.215 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-07-14T02:58:48.246 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-07-14T02:58:58.291 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T02:59:02.587 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T02:59:02.614 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T02:59:02.615 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 10} 2023-07-14T02:59:02.653 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T02:59:02.654 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 10} 2023-07-14T02:59:02.684 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2023-07-14T02:59:02.684 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T02:59:02.720 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream 2023-07-14T02:59:02.720 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-14T02:59:02.825 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T02:59:02.828 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T02:59:02.875 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-07-14T02:59:02.878 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-07-14T02:59:02.948 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-14T02:59:02.951 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T02:59:03.106 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-14T02:59:03.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T02:59:03.124 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-14T02:59:03.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T02:59:03.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:03.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:07.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:07.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:11.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:11.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:16.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:16.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:21.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:21.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:21.726 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-14T02:59:21.827 INFO:teuthology.orchestra.console:Power on smithi088 2023-07-14T02:59:21.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T02:59:21.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:25.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:26.090 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-07-14T02:59:26.192 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-07-14T02:59:26.192 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T02:59:31.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:36.311 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:41.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:41.631 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-14T02:59:41.732 INFO:teuthology.orchestra.console:Power on smithi159 2023-07-14T02:59:41.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T02:59:41.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:46.304 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T02:59:51.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T02:59:56.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:01.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:06.417 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T03:00:11.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:16.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:21.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:26.537 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T03:00:31.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:36.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:41.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:46.648 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-14T03:00:48.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:00:48.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:00:49.071 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-07-14T03:00:49.172 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-07-14T03:00:49.172 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-14T03:00:49.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:00:51.984 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-14T03:00:52.272 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:00:57.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:00:58.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:01:01.328 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:01:07.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:01:30.088 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T03:01:30.089 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T03:01:30.379 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-07-14T03:01:30.380 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-07-14T03:01:30.397 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 2023-07-14T03:01:30.397 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088 /etc/hosts 2023-07-14T03:01:30.454 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-07-14T03:01:30.455 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088 smithi088 2023-07-14T03:01:30.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-07-14T03:01:30.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hosts 2023-07-14T03:01:30.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-07-14T03:01:30.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hostname 2023-07-14T03:01:30.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-07-14T03:01:30.773 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-07-14T03:01:30.832 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-07-14T03:01:30.832 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-07-14T03:01:30.832 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-07-14T03:01:30.832 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-07-14T03:01:30.833 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T03:01:30.834 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T03:01:30.834 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T03:01:30.836 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi088's OS to be centos 9 but found centos 8 2023-07-14T03:01:30.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T03:01:30.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T03:01:35.845 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:01:35.923 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T03:01:36.042 DEBUG:teuthology.nuke:shortname: smithi088 2023-07-14T03:01:36.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T03:01:36.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336798', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 02:57:57.039451', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeIfyhDR2/4+u8ANGZ8DJlj70n2hYRmKOxj3mPMELIkY1hcZoCIfoT4rNyCq4JStNRIOMMrlgYlwLvlt5fMOOWiJwKQmOUe7fHAwLycczJk6k5cZNDZLZvgFZVbjTB51p04nJIDvwIWZ8ouF8gXMzvfQ4is+PIBBV9elb34eJzYHviegqYBTTvBAOlDMchHmkDWyP6y877jmC+49ar4fxl1NeMdtbMs6CAYfIlpAeqzRCsc/ctor/pd+vIFy8vD2+qEvWnCfta7J3HNyGX6q0GWhxgtHQ5JnfwklrsjK98CmWNlqjlxj8cnhwjw9j1IxTJ0+UvfLksuc6xbQ/72ypgEpc08FWMez2Z12wNvuFMR2m0i2YHuvKnAZQcmNoWLsMoSFYDlQp29ACaGZcbIHwKOKhMb3Q8cI0TLUfpvloQMzIJybD3e0zgPGzvxEOJvOTbUk0HWVhr/yVJLpptxV19s7xKbt38gJI3ugUak1//MnKN+Re0JEUqPUJ5O2om9mc='} 2023-07-14T03:01:36.072 DEBUG:teuthology.nuke:shortname: smithi159 2023-07-14T03:01:36.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T03:01:36.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336798', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 02:57:57.041711', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/dbEekBHSkJlJK0XvFPK6vlXhrwRAq4zr69upYhlflwfcMOnLfPu72GLWPi9q1NwRSwDmhXD1bWcv7kLm6s78zrWrqHjFSlbCE4vCgpQaY9BY5K2WwtTZn111nFyr24ZT3y0nP9ZrxFuApQsTbLcOkZteXErAan2tlwwOJcUkVQAcNsFptUwn4/ntKWwXcDkOML3+0/fiVNiViX36c2mGeYzBuZJ/GI7BcAeT5SkqZP6D9MP/sOtTnewUKl7Xg6Ogd00ZxPprtZirzmtohsDLoqla4VjtIpfWjfmUeOMBQ20KXWeAGvrfF1KdNZW68+PL66S7zmrmtIli1TweXXDXGRJrQ/o4CUn69wSjqsaAWeAQZkgtn2QaRuVYVZP0AUWL2lYZ3K8qg13jGewdgskdHeaKXGr2rT6gAB6ZIhHjGFfiJxMTy9kXKulphQ+hB91DnYIqZZ6rfMNlujJ98OCEW0Q6ywMwBD13Ws0/MPZbpFLODFZpW5mnoHu3FjJq1TM='} 2023-07-14T03:01:36.134 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-14T03:01:36.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T03:01:36.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:36.175 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-14T03:01:36.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T03:01:36.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:40.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:40.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:41.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:01:44.912 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:01:45.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:45.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:50.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:50.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:01:50.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:01:56.022 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-14T03:02:01.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:01.137 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:02:02.709 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com 2023-07-14T03:02:07.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:02:12.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:15.216 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:02:17.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:21.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:02:26.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:29.296 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:02:31.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:35.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:02:40.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T03:02:40.514 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-14T03:02:45.621 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:02:50.677 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-07-14T03:02:55.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T03:03:02.453 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-14T03:03:02.588 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi088's OS to be centos 9 but found centos 8