2024-02-11T08:00:26.530 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-11T08:00:26.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T08:00:26.680 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f230cdd0c10>, signals=[15]) 2024-02-11T08:00:26.680 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-02-11T08:00:26.680 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-02-11T08:00:26.680 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-02-11T08:00:26.699 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-02-11T08:00:26.699 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-02-11T08:00:26.699 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-02-11T08:00:26.808 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10) 2024-02-11T08:00:26.823 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2024-02-11T08:00:26.856 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream 2024-02-11T08:00:26.865 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2024-02-11T08:00:27.112 INFO:teuthology.orchestra.console.smithi179:Power off 2024-02-11T08:00:27.112 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-11T08:00:27.127 INFO:teuthology.orchestra.console.smithi132:Power off 2024-02-11T08:00:27.128 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-11T08:00:27.136 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-02-11T08:00:27.137 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:27.150 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-02-11T08:00:27.150 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:27.159 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:00:27.174 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-02-11T08:00:31.164 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:31.174 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:31.275 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:00:31.282 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-02-11T08:00:35.280 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:35.287 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:35.389 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:00:35.398 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-02-11T08:00:35.499 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-02-11T08:00:35.599 INFO:teuthology.orchestra.console.smithi132:Power on 2024-02-11T08:00:35.600 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-11T08:00:35.622 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-02-11T08:00:35.622 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:35.649 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-02-11T08:00:39.393 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:39.504 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-11T08:00:39.604 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-02-11T08:00:39.650 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:39.706 INFO:teuthology.orchestra.console.smithi179:Power on 2024-02-11T08:00:39.706 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-11T08:00:39.727 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-02-11T08:00:39.727 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:39.750 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-11T08:00:39.758 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-02-11T08:00:43.753 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:43.761 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:43.863 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-11T08:00:43.869 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-02-11T08:00:43.969 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-02-11T08:00:44.070 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-02-11T08:00:47.866 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:00:47.977 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:00:48.078 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-02-11T08:00:48.178 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-02-11T08:00:48.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:06.620 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:12.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:15.708 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:21.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:24.764 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:30.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:33.823 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:39.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:42.908 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:48.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:01:51.967 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:01:57.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:02:16.508 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:02:22.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:02:23.237 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:02:29.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:02:29.376 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:02:33.512 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:02:40.605 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:02:50.701 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:03:03.812 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:03:14.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:03:19.911 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:03:33.308 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-02-11T08:03:39.047 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-11T08:03:39.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:03:42.368 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-02-11T08:03:48.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:03:51.420 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-02-11T08:03:57.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:04:00.476 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-02-11T08:04:06.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:04:35.516 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:04:41.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:04:44.572 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:04:50.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:04:53.628 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-02-11T08:04:59.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:05:06.479 WARNING:teuthology.provision.fog.smithi132:timed out 2024-02-11T08:05:12.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:05:12.737 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-11T08:05:12.738 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-11T08:05:13.056 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-02-11T08:05:13.056 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-02-11T08:05:13.070 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2024-02-11T08:05:13.071 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2024-02-11T08:05:13.126 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-02-11T08:05:13.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-02-11T08:05:13.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2024-02-11T08:05:13.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-02-11T08:05:13.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2024-02-11T08:05:13.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-02-11T08:05:13.463 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-11T08:05:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-02-11T08:05:13.522 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-11T08:05:13.522 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-11T08:05:13.522 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-11T08:05:13.522 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-02-11T08:05:13.524 DEBUG:teuthology.parallel:result is None 2024-02-11T08:05:59.631 WARNING:teuthology.provision.fog.smithi179:timed out 2024-02-11T08:06:05.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T08:06:05.859 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-11T08:06:05.860 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-11T08:06:06.350 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-02-11T08:06:06.351 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-02-11T08:06:06.402 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-02-11T08:06:06.402 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-02-11T08:06:06.450 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-02-11T08:06:06.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-02-11T08:06:06.588 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-02-11T08:06:06.601 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-02-11T08:06:06.658 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-02-11T08:06:06.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-02-11T08:06:06.774 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-11T08:06:06.822 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-11T08:06:06.823 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-11T08:06:06.823 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-11T08:06:06.823 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-02-11T08:06:06.824 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi179's OS to be centos 9 but found ubuntu 22.04 2024-02-11T08:06:06.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T08:06:07.110 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e7cd030d423044b78622e83a150ec1ad Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi179's OS to be centos 9 but found ubuntu 22.04 2024-02-11T08:06:07.113 INFO:teuthology.nuke:Checking targets against current locks 2024-02-11T08:06:07.183 DEBUG:teuthology.nuke:shortname: smithi132 2024-02-11T08:06:07.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-11T08:06:07.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-10_17:31:55-rados-wip-yuri6-testing-2024-02-09-1422-distro-default-smithi/7555989', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-11 08:00:25.453454', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIY28YG7BnFujD4qSDgf3URf26vvsOrTiNeEdYaYtORUN0cc7igL+htq7/5wZ+ot/EjUyDUwBZXRHmiVEJjXhg4='} 2024-02-11T08:06:07.208 DEBUG:teuthology.nuke:shortname: smithi179 2024-02-11T08:06:07.209 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-11T08:06:07.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-10_17:31:55-rados-wip-yuri6-testing-2024-02-09-1422-distro-default-smithi/7555991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-11 08:00:26.120108', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCPy3gBuRyOsAqJCI3lbJME7OhVbLbmyVlZJqI/089b0PS9dJTzkDlN2pQIh4iVktdO7I32YElb+fATpoERmXpU='} 2024-02-11T08:06:07.253 INFO:teuthology.orchestra.console.smithi132:Power off 2024-02-11T08:06:07.253 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-11T08:06:07.276 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-02-11T08:06:07.276 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:07.291 INFO:teuthology.orchestra.console.smithi179:Power off 2024-02-11T08:06:07.292 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-11T08:06:07.301 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-02-11T08:06:07.313 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-02-11T08:06:07.314 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:07.335 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:06:11.302 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:11.336 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:11.412 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-02-11T08:06:11.447 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-02-11T08:06:15.412 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:15.447 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T08:06:15.522 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-02-11T08:06:15.558 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-02-11T08:06:15.623 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-02-11T08:06:15.658 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-02-11T08:06:15.768 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2024-02-11T08:06:15.810 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2024-02-11T08:06:16.093 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi179's OS to be centos 9 but found ubuntu 22.04