2023-12-06T21:46:33.279 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T21:46:33.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T21:46:33.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f11a2be1ee0>, signals=[15]) 2023-12-06T21:46:33.423 INFO:teuthology.lock.ops:Start node 'smithi091.front.sepia.ceph.com' reimaging 2023-12-06T21:46:33.423 INFO:teuthology.lock.ops:Updating [smithi091.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T21:46:33.423 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-12-06T21:46:33.442 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2023-12-06T21:46:33.442 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2023-12-06T21:46:33.442 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-12-06T21:46:33.578 DEBUG:teuthology.provision.fog.smithi091:Requesting image smithi_centos_8.stream (ID 3) 2023-12-06T21:46:33.581 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3) 2023-12-06T21:46:33.646 INFO:teuthology.provision.fog.smithi091:Scheduling deploy of centos 8.stream 2023-12-06T21:46:33.650 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream 2023-12-06T21:46:33.712 DEBUG:teuthology.provision.fog.smithi091:Canceling deploy task with ID 648009 2023-12-06T21:46:33.933 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-06T21:46:33.934 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T21:46:33.962 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-06T21:46:33.962 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:33.984 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:46:34.013 INFO:teuthology.orchestra.console.smithi091:Power off 2023-12-06T21:46:34.013 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T21:46:34.035 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-12-06T21:46:34.036 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:34.060 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:46:37.988 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:38.061 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:38.097 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:46:38.171 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:46:42.102 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:42.172 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:42.212 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:46:42.282 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:46:46.215 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:46.283 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:46.326 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-06T21:46:46.391 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-06T21:46:46.427 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-06T21:46:46.493 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-12-06T21:46:46.529 INFO:teuthology.orchestra.console.smithi196:Power on 2023-12-06T21:46:46.529 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T21:46:46.552 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2023-12-06T21:46:46.552 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:46.576 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-06T21:46:46.595 INFO:teuthology.orchestra.console.smithi091:Power on 2023-12-06T21:46:46.595 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-06T21:46:46.615 DEBUG:teuthology.orchestra.console.smithi091:power on output: Chassis Power Control: Up/On 2023-12-06T21:46:46.616 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:46.637 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-06T21:46:50.578 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:50.638 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:46:50.687 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:46:50.747 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:46:50.789 INFO:teuthology.orchestra.console.smithi196:Power on completed 2023-12-06T21:46:50.848 INFO:teuthology.orchestra.console.smithi091:Power on completed 2023-12-06T21:46:50.890 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2023-12-06T21:46:50.950 INFO:teuthology.provision.fog.smithi091:Waiting for deploy to finish 2023-12-06T21:49:36.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:49:36.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:49:40.034 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-06T21:49:46.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:49:49.126 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-06T21:49:55.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:49:58.214 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-06T21:50:04.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:50:07.302 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-06T21:50:11.554 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:50:13.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:50:16.386 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-06T21:50:17.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:50:20.610 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:50:22.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:50:26.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:50:29.666 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:50:35.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:51:22.439 WARNING:teuthology.provision.fog.smithi196:timed out 2023-12-06T21:51:28.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:51:28.692 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T21:51:28.693 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T21:51:28.959 INFO:teuthology.provision.fog.smithi196:Node is ready 2023-12-06T21:51:28.959 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2023-12-06T21:51:28.978 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2023-12-06T21:51:28.979 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2023-12-06T21:51:29.038 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2023-12-06T21:51:29.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-06T21:51:29.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2023-12-06T21:51:29.195 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2023-12-06T21:51:29.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2023-12-06T21:51:29.334 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-06T21:51:29.403 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-12-06T21:51:29.461 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2023-12-06T21:51:29.462 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2023-12-06T21:51:29.462 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2023-12-06T21:51:29.462 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2023-12-06T21:51:29.462 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2023-12-06T21:51:29.462 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T21:51:29.463 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T21:51:29.464 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2023-12-06T21:51:29.465 DEBUG:teuthology.parallel:result is None 2023-12-06T21:51:35.678 WARNING:teuthology.provision.fog.smithi091:timed out 2023-12-06T21:51:41.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:51:41.683 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:51:47.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:52:47.748 WARNING:teuthology.provision.fog.smithi091:timed out 2023-12-06T21:52:53.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:52:56.834 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:02.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:05.890 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:11.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:14.852 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:20.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:26.982 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:32.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:36.066 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:42.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:42.074 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:53:48.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:53:48.199 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:53:52.321 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:53:59.401 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:54:09.485 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:54:22.565 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:54:38.648 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:54:57.731 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:55:19.816 ERROR:teuthology.orchestra.connection:Error authenticating with smithi091.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-06T21:56:00.674 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:06.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:56:09.730 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:15.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:56:18.790 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:24.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:56:24.930 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:30.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:56:30.946 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:36.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:56:40.002 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:56:46.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:57:04.482 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:57:10.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:57:13.538 WARNING:teuthology.provision.fog.smithi091:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-06T21:57:19.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T21:57:22.222 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-06T21:57:22.223 DEBUG:teuthology.orchestra.run.smithi091:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-06T21:57:43.170 INFO:teuthology.provision.fog.smithi091:Node is ready 2023-12-06T21:57:43.170 DEBUG:teuthology.orchestra.run.smithi091:> hostname 2023-12-06T21:57:43.177 INFO:teuthology.orchestra.run.smithi091.stdout:smithi129 2023-12-06T21:57:43.178 DEBUG:teuthology.orchestra.run.smithi091:> grep smithi129 /etc/hosts 2023-12-06T21:57:43.227 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.15.129 smithi129 smithi129 2023-12-06T21:57:43.228 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091 2023-12-06T21:57:43.250 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi129/smithi091/g' /etc/hosts 2023-12-06T21:57:43.268 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/172.21.15.129/172.21.15.91/g' /etc/hosts 2023-12-06T21:57:43.282 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i -e 's/smithi129/smithi091/g' /etc/hostname 2023-12-06T21:57:43.338 DEBUG:teuthology.orchestra.run.smithi091:> sudo hostname smithi091 2023-12-06T21:57:43.353 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-12-06T21:57:43.359 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu" 2023-12-06T21:57:43.359 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="20.04" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=focal 2023-12-06T21:57:43.360 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=focal 2023-12-06T21:57:43.362 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi091's OS to be centos 8 but found ubuntu 20.04 2023-12-06T21:57:43.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T21:57:43.509 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7630eb47e67c462ba19146026a37d152 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi091's OS to be centos 8 but found ubuntu 20.04 2023-12-06T21:57:43.511 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T21:57:43.571 DEBUG:teuthology.nuke:shortname: smithi091 2023-12-06T21:57:43.571 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T21:57:43.593 DEBUG:teuthology.nuke:shortname: smithi196 2023-12-06T21:57:43.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T21:57:43.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2023-12-06_20:07:47-orch:cephadm-wip-phlogistonjohn-testing-2023-12-06-1007-distro-default-smithi/7480765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 21:51:55.424330', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-06T21:57:43.619 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2023-12-06_20:07:47-orch:cephadm-wip-phlogistonjohn-testing-2023-12-06-1007-distro-default-smithi/7480759', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 21:46:32.427094', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2y+z6xjz5aHqrMyPzBNjRJ8GATq+hjE9eZCVbwTJsiTjniaVtcXI3ENv8+SF2nwjzX612dgGB8RvKp08WJpOU='} 2023-12-06T21:57:43.651 INFO:teuthology.orchestra.console.smithi091:Power off 2023-12-06T21:57:43.651 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T21:57:43.673 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-12-06T21:57:43.674 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:43.690 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-06T21:57:43.691 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T21:57:43.700 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:57:43.712 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-06T21:57:43.713 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:43.737 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:57:47.701 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:47.738 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:47.812 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-06T21:57:47.848 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-06T21:57:51.813 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:51.849 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T21:57:51.923 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-06T21:57:51.958 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-06T21:57:52.024 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-12-06T21:57:52.059 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-06T21:57:52.181 INFO:teuthology.lock.ops:unlocked: smithi091.front.sepia.ceph.com 2023-12-06T21:57:52.205 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2023-12-06T21:57:52.463 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi091's OS to be centos 8 but found ubuntu 20.04