2024-02-01T03:25:24.231 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-01T03:25:24.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-01T03:25:24.412 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c355b2c10>, signals=[15]) 2024-02-01T03:25:24.412 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-02-01T03:25:24.413 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-02-01T03:25:24.413 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-02-01T03:25:24.435 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-01T03:25:24.435 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-01T03:25:24.435 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-01T03:25:24.548 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-01T03:25:24.596 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of ubuntu 20.04 2024-02-01T03:25:24.622 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-01T03:25:24.669 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 20.04 2024-02-01T03:25:25.022 INFO:teuthology.orchestra.console.smithi008:Power off 2024-02-01T03:25:25.022 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-01T03:25:25.045 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-02-01T03:25:25.045 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:25.071 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-01T03:25:25.093 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-01T03:25:25.094 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-01T03:25:25.114 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-01T03:25:25.115 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:25.134 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-01T03:25:25.173 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-02-01T03:25:25.235 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-01T03:25:25.274 INFO:teuthology.orchestra.console.smithi008:Power on 2024-02-01T03:25:25.274 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-01T03:25:25.296 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-02-01T03:25:25.296 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:25.317 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-01T03:25:25.336 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-01T03:25:25.336 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-01T03:25:25.356 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-01T03:25:25.357 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:25.379 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-01T03:25:29.322 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:29.381 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:29.431 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-01T03:25:29.489 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-01T03:25:33.436 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:33.491 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:25:33.583 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-01T03:25:33.598 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-01T03:25:33.685 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-02-01T03:25:33.699 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-01T03:25:33.786 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-02-01T03:25:33.800 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-01T03:25:33.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:25:52.316 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:25:58.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:01.376 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:26:07.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:10.464 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:26:16.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:19.548 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:26:25.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:28.636 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:26:34.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:37.692 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:26:43.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:26:54.012 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:27:00.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:27:03.100 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:27:09.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:27:09.242 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:27:13.376 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:27:20.511 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:27:30.648 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:27:43.783 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:27:59.917 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:28:19.051 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:28:41.149 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:29:06.284 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:29:34.381 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:29:34.381 WARNING:teuthology.provision.fog.smithi191:'connect to smithi191.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-02-01T03:29:40.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:29:40.475 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:29:44.611 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:29:51.705 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:30:01.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:30:14.939 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-01T03:30:52.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:30:55.804 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:01.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:04.860 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:10.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:13.916 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:19.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:22.972 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:28.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:30.943 WARNING:teuthology.provision.fog.smithi191:timed out 2024-02-01T03:31:32.028 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:36.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:41.020 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:31:41.084 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-01T03:31:47.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:47.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:47.900 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:31:53.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:31:56.956 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-01T03:32:02.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-01T03:32:03.176 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-01T03:32:03.176 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-01T03:32:23.668 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-01T03:32:23.668 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-01T03:32:23.693 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-01T03:32:23.693 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-01T03:32:23.753 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-01T03:32:23.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-01T03:32:23.869 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-01T03:32:23.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-01T03:32:23.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-01T03:32:24.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-01T03:32:24.108 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-01T03:32:24.166 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-01T03:32:24.166 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2024-02-01T03:32:24.166 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-01T03:32:24.166 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-01T03:32:24.166 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-01T03:32:24.167 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-01T03:32:24.170 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi191's OS to be ubuntu 20.04 but found centos 8 2024-02-01T03:32:24.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-01T03:32:24.457 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cf91ff327f244caa8a68df4af3875cec Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi191's OS to be ubuntu 20.04 but found centos 8 2024-02-01T03:32:24.459 INFO:teuthology.nuke:Checking targets against current locks 2024-02-01T03:32:24.520 DEBUG:teuthology.nuke:shortname: smithi008 2024-02-01T03:32:24.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-01T03:32:24.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-01_02:25:04-upgrade:reef-x-main-distro-default-smithi/7541599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-01 03:25:23.208990', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGbYSXbRmsUjqdd2xiRbOT7RR0/PanySxErzmDjePEOfNzYw+/InIueMWDR9pkyeYSepnl+Re9XR5YxaYzHNG1U='} 2024-02-01T03:32:24.549 DEBUG:teuthology.nuke:shortname: smithi191 2024-02-01T03:32:24.549 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-01T03:32:24.567 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-01_02:25:04-upgrade:reef-x-main-distro-default-smithi/7541601', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-01 03:25:23.598390', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwwz5IM1/2FF+iYkxKx/7XWWu2QRni6bfgz2LAO100UcsjM0fuXT/+dChNFEdXWWH0Rtiek5kHWic+Fo6mNcmg='} 2024-02-01T03:32:24.595 INFO:teuthology.orchestra.console.smithi008:Power off 2024-02-01T03:32:24.595 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-01T03:32:24.611 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-01T03:32:24.611 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-01T03:32:24.622 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-02-01T03:32:24.622 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:24.636 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-01T03:32:24.637 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:24.646 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-01T03:32:24.660 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-01T03:32:28.647 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:28.662 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:28.758 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-01T03:32:28.772 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-01T03:32:32.759 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:32.772 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:32.871 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-01T03:32:32.885 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-01T03:32:32.972 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-02-01T03:32:33.126 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2024-02-01T03:32:36.886 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-01T03:32:36.996 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-01T03:32:37.098 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-01T03:32:37.252 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com 2024-02-01T03:32:37.526 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi191's OS to be ubuntu 20.04 but found centos 8