2023-08-15T21:52:02.400 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T21:52:02.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T21:52:02.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6809532f70>, signals=[15]) 2023-08-15T21:52:02.552 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-08-15T21:52:02.553 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T21:52:02.553 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-08-15T21:52:02.579 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-08-15T21:52:02.579 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T21:52:02.580 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-08-15T21:52:02.582 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-08-15T21:52:04.987 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-08-15T21:52:20.081 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T21:52:20.082 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T21:52:25.159 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T21:52:25.159 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 2} 2023-08-15T21:52:25.201 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T21:52:25.201 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 2} 2023-08-15T21:52:25.295 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 20.04 2023-08-15T21:52:25.296 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-08-15T21:52:25.336 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 20.04 2023-08-15T21:52:25.337 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-15T21:52:35.331 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T21:52:35.412 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-08-15T21:52:35.468 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T21:52:40.475 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-08-15T21:52:45.526 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-08-15T21:52:55.522 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-15T21:53:00.553 INFO:teuthology.orchestra.console.smithi033:Power off 2023-08-15T21:53:00.554 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T21:53:05.498 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-15T21:53:05.499 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T21:53:05.524 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-15T21:53:05.525 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:05.550 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-15T21:53:05.651 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-15T21:53:05.752 INFO:teuthology.orchestra.console.smithi164:Power on 2023-08-15T21:53:05.752 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T21:53:10.777 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2023-08-15T21:53:10.778 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:11.788 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:53:15.590 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-08-15T21:53:15.591 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:15.790 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:16.602 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:53:16.900 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:53:20.608 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:20.902 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:21.720 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:53:22.013 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:53:25.725 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:26.014 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:26.836 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:53:27.125 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:53:30.838 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:31.126 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:31.237 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-15T21:53:31.339 INFO:teuthology.orchestra.console.smithi164:Power on completed 2023-08-15T21:53:31.440 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-08-15T21:53:31.440 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-08-15T21:53:36.449 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:53:36.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:53:41.553 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:41.664 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-08-15T21:53:41.765 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-08-15T21:53:41.866 INFO:teuthology.orchestra.console.smithi033:Power on 2023-08-15T21:53:41.866 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T21:53:44.624 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-15T21:53:46.895 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-08-15T21:53:46.895 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:47.904 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:53:50.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:53:55.633 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:53:55.744 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-08-15T21:53:55.845 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-08-15T21:53:55.946 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-08-15T21:53:55.947 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-08-15T21:53:56.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:53:58.704 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-15T21:54:04.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:09.776 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-15T21:54:15.284 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-08-15T21:54:15.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:18.836 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-15T21:54:21.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:26.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:31.297 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-08-15T21:54:34.352 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-08-15T21:54:37.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:41.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:54:44.560 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-08-15T21:54:50.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:55:27.306 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T21:55:27.307 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T21:55:27.634 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-08-15T21:55:27.634 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-08-15T21:55:27.650 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-08-15T21:55:27.651 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-08-15T21:55:27.704 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-08-15T21:55:27.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-08-15T21:55:27.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-08-15T21:55:27.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-08-15T21:55:28.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-08-15T21:55:28.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-08-15T21:55:28.159 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-08-15T21:55:28.215 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T21:55:28.215 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-08-15T21:55:28.215 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-15T21:55:28.216 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T21:55:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-15T21:55:28.220 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be ubuntu 20.04 but found rhel 8.6 2023-08-15T21:55:28.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T21:55:33.366 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d423bb22a9ac475b92c7324c0436bd11 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be ubuntu 20.04 but found rhel 8.6 2023-08-15T21:55:33.368 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T21:55:43.394 WARNING:teuthology.provision.fog.smithi164:timed out 2023-08-15T21:55:53.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T21:55:53.460 DEBUG:teuthology.nuke:shortname: smithi033 2023-08-15T21:55:53.460 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T21:56:03.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368837', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 21:52:01.594036', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-15T21:56:03.495 DEBUG:teuthology.nuke:shortname: smithi164 2023-08-15T21:56:03.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T21:56:03.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368837', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 21:52:01.592621', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-15T21:56:08.581 INFO:teuthology.orchestra.console.smithi033:Power off 2023-08-15T21:56:08.582 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T21:56:08.607 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-08-15T21:56:08.608 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:08.627 INFO:teuthology.orchestra.console.smithi164:Power off 2023-08-15T21:56:08.628 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T21:56:08.639 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-08-15T21:56:08.652 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-08-15T21:56:08.653 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:08.677 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-15T21:56:08.821 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T21:56:08.821 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T21:56:09.101 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-08-15T21:56:09.101 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-08-15T21:56:09.119 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164 2023-08-15T21:56:09.119 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164 /etc/hosts 2023-08-15T21:56:09.176 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-08-15T21:56:09.177 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164 smithi164 2023-08-15T21:56:09.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-15T21:56:09.302 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164/smithi164/g' /etc/hosts 2023-08-15T21:56:09.331 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-08-15T21:56:09.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164/smithi164/g' /etc/hostname 2023-08-15T21:56:09.467 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-08-15T21:56:09.533 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-08-15T21:56:09.590 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T21:56:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-08-15T21:56:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-08-15T21:56:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-08-15T21:56:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-08-15T21:56:09.592 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-08-15T21:56:09.592 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-15T21:56:09.592 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-08-15T21:56:09.592 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-15T21:56:09.592 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T21:56:09.593 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T21:56:09.593 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T21:56:09.593 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-08-15T21:56:09.593 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T21:56:09.593 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-15T21:56:09.594 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T21:56:09.594 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-15T21:56:12.640 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:12.678 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:12.790 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-08-15T21:56:13.751 DEBUG:teuthology.orchestra.console.smithi033:check power output: 2023-08-15T21:56:16.792 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:17.752 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:17.863 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-08-15T21:56:17.902 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:56:17.965 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-08-15T21:56:23.073 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:25.844 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-08-15T21:56:26.750 DEBUG:teuthology.orchestra.console.smithi164:check power output: 2023-08-15T21:56:30.754 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T21:56:31.857 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-08-15T21:56:31.958 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-08-15T21:56:42.116 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com 2023-08-15T21:56:42.323 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be ubuntu 20.04 but found rhel 8.6