2023-12-02T22:55:56.627 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-02T22:55:56.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T22:55:56.802 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d0c2e5550>, signals=[15]) 2023-12-02T22:55:56.803 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-12-02T22:55:56.804 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-12-02T22:55:56.804 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-12-02T22:55:56.826 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2023-12-02T22:55:56.826 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2023-12-02T22:55:56.826 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-02T22:55:56.851 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-12-02T22:55:56.851 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-12-02T22:55:56.851 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-02T22:55:56.935 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2023-12-02T22:55:56.970 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10) 2023-12-02T22:55:56.975 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2023-12-02T22:55:56.995 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2023-12-02T22:55:57.014 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream 2023-12-02T22:55:57.043 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2023-12-02T22:55:57.211 INFO:teuthology.orchestra.console.smithi072:Power off 2023-12-02T22:55:57.212 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T22:55:57.234 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-12-02T22:55:57.234 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:55:57.253 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-02T22:55:57.253 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T22:55:57.266 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-02T22:55:57.266 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T22:55:57.273 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-02T22:55:57.276 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-02T22:55:57.276 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:55:57.286 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-02T22:55:57.286 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:55:57.296 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T22:55:57.307 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-02T22:56:01.274 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:01.297 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:01.308 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:01.387 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-02T22:56:01.408 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T22:56:01.417 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-02T22:56:05.390 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.409 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.417 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.499 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-02T22:56:05.517 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-02T22:56:05.526 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-02T22:56:05.600 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-12-02T22:56:05.618 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-02T22:56:05.627 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-02T22:56:05.702 INFO:teuthology.orchestra.console.smithi072:Power on 2023-12-02T22:56:05.702 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-02T22:56:05.719 INFO:teuthology.orchestra.console.smithi156:Power on 2023-12-02T22:56:05.719 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-02T22:56:05.727 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-12-02T22:56:05.728 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.734 INFO:teuthology.orchestra.console.smithi113:Power on 2023-12-02T22:56:05.734 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-02T22:56:05.744 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-12-02T22:56:05.744 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.753 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-02T22:56:05.755 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2023-12-02T22:56:05.755 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:05.765 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-02T22:56:05.807 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-02T22:56:09.754 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:09.766 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:09.808 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:09.862 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-02T22:56:09.874 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-02T22:56:09.916 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-02T22:56:13.867 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:13.875 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:13.917 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T22:56:13.982 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T22:56:13.990 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-02T22:56:14.025 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-02T22:56:14.084 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-12-02T22:56:14.091 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-12-02T22:56:14.126 INFO:teuthology.orchestra.console.smithi113:Power on completed 2023-12-02T22:56:14.185 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-12-02T22:56:14.191 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-12-02T22:56:14.227 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2023-12-02T22:59:00.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:00.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:03.334 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:09.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:12.418 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:15.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:18.406 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T22:59:18.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:18.758 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T22:59:21.474 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:24.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:24.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:27.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:27.494 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T22:59:27.810 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T22:59:30.534 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:33.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:33.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:36.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:36.578 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T22:59:36.866 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T22:59:39.622 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:42.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:42.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:45.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:45.638 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T22:59:45.922 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T22:59:48.710 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T22:59:51.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:51.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:54.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T22:59:54.726 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T22:59:54.982 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T22:59:57.798 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T23:00:00.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:00.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:03.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:03.810 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:00:04.070 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T23:00:06.886 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T23:00:09.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:10.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:12.866 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:00:12.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:15.938 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-02T23:00:18.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:20.194 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T23:00:21.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:26.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:29.250 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T23:00:35.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:38.306 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-02T23:00:44.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:00:45.780 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-02T23:00:45.780 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-02T23:01:06.145 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-12-02T23:01:06.146 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-12-02T23:01:06.164 INFO:teuthology.orchestra.run.smithi156.stdout:smithi046 2023-12-02T23:01:06.164 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi046 /etc/hosts 2023-12-02T23:01:06.221 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-12-02T23:01:06.222 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-02T23:01:06.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi046/smithi156/g' /etc/hosts 2023-12-02T23:01:06.424 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.46/172.21.15.156/g' /etc/hosts 2023-12-02T23:01:06.491 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi046/smithi156/g' /etc/hostname 2023-12-02T23:01:06.559 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-02T23:01:06.626 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-12-02T23:01:06.680 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-02T23:01:06.681 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-02T23:01:06.682 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-12-02T23:01:06.683 DEBUG:teuthology.parallel:result is None 2023-12-02T23:01:18.882 WARNING:teuthology.provision.fog.smithi072:timed out 2023-12-02T23:01:21.946 WARNING:teuthology.provision.fog.smithi113:timed out 2023-12-02T23:01:24.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:01:27.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:01:28.186 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-02T23:01:28.186 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-02T23:01:28.500 INFO:teuthology.provision.fog.smithi113:Node is ready 2023-12-02T23:01:28.501 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2023-12-02T23:01:28.515 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2023-12-02T23:01:28.521 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2023-12-02T23:01:28.574 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2023-12-02T23:01:28.574 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-02T23:01:28.676 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2023-12-02T23:01:28.704 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2023-12-02T23:01:28.776 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2023-12-02T23:01:28.847 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-02T23:01:28.917 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-02T23:01:28.976 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2023-12-02T23:01:28.976 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2023-12-02T23:01:28.976 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-02T23:01:28.977 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-02T23:01:28.978 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-02T23:01:28.978 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2023-12-02T23:01:28.978 DEBUG:teuthology.parallel:result is None 2023-12-02T23:01:43.398 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:01:49.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:01:52.482 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:01:58.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:01.542 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:07.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:10.630 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:16.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:19.718 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:25.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:28.806 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:34.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:37.894 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:43.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:46.982 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:02:52.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:02:56.070 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:02.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:05.154 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:11.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:14.215 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:20.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:23.298 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:29.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:32.354 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:38.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:41.414 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:47.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:50.498 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:03:56.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:03:59.586 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:05.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:08.642 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:14.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:17.730 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:23.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:26.790 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:32.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:35.878 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:41.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:44.962 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:04:50.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:04:54.018 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:00.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:03.074 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:09.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:12.162 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:18.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:21.222 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:27.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:30.306 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:36.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:39.362 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:45.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:48.418 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:05:54.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:05:57.474 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:03.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:06.534 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:12.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:15.622 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:21.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:24.706 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:30.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:33.762 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:39.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:42.850 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:48.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:06:51.906 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:06:57.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:00.962 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:06.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:10.018 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:16.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:19.074 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:25.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:28.130 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:34.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:37.190 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:43.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:46.274 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:07:52.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:07:55.362 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:01.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:04.418 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:10.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:13.481 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:19.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:22.566 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:28.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:31.650 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:37.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:40.706 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:46.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:49.766 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:08:55.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:08:58.850 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:04.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:07.938 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:13.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:16.994 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:23.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:26.082 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:32.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:35.138 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:41.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:44.194 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:50.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:09:53.250 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:09:59.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:02.306 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:08.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:11.366 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:17.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:20.450 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:26.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:29.542 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:35.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:38.630 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:44.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:47.714 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:10:53.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:10:56.770 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:02.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:05.830 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:11.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:14.914 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:20.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:23.970 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:29.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:33.030 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:39.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:42.114 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:48.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:11:51.170 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:11:57.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:00.230 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:06.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:09.314 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:15.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:18.402 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:24.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:27.458 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:33.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:36.518 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:42.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:45.602 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:12:51.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:12:54.658 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:00.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:03.714 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:09.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:12.770 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:18.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:21.826 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:27.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:30.918 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:36.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:40.002 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:46.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:49.058 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:13:55.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:13:58.118 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:04.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:07.206 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:13.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:16.290 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:22.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:25.350 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:31.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:34.435 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:40.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:43.494 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:49.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:14:52.578 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:14:58.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:15:01.634 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:15:07.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:15:10.690 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:15:16.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:15:19.750 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:15:25.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T23:15:28.838 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-02T23:15:28.841 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-12-02T23:15:28.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T23:15:29.006 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=199dc447212c497ba784a233b15aad7a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-12-02T23:15:29.008 INFO:teuthology.nuke:Checking targets against current locks 2023-12-02T23:15:29.084 DEBUG:teuthology.nuke:shortname: smithi072 2023-12-02T23:15:29.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T23:15:29.092 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-02T23:15:29.092 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T23:15:29.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 22:55:55.735874', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO/MfZfAhIA6LRCe2lbTI415O7bHAseKF6EgcNItZKNQRWLbqjk06Qn+82Kvrh2AUON1juE7RPZtA8gNZLnXfjw='} 2023-12-02T23:15:29.111 DEBUG:teuthology.nuke:shortname: smithi156 2023-12-02T23:15:29.111 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T23:15:29.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 22:55:55.737670', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIVgAlQFyn6AmtJJdlgHApaqdchLYBRGWK7cKaCm/yoR/qjgtkIGfnst+qb5KFtUpDyaJ5F88t2kOT8mK+h44E='} 2023-12-02T23:15:29.137 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 22:55:55.739079', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwRtUExhWPERr571GQPjYlRtP8DC2s/YP2pZAgcBLVOmVPj4ihdDYV4BuhYYc0ioDoMCQruVPirTcGE7lZxv2U='} 2023-12-02T23:15:29.167 INFO:teuthology.orchestra.console.smithi072:Power off 2023-12-02T23:15:29.167 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T23:15:29.184 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-02T23:15:29.184 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T23:15:29.196 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-12-02T23:15:29.196 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:29.206 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-02T23:15:29.207 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:29.223 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-02T23:15:29.223 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T23:15:29.232 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-02T23:15:29.233 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-02T23:15:29.245 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-02T23:15:29.246 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:29.269 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T23:15:33.235 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:33.244 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:33.270 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:33.347 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-02T23:15:33.354 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-02T23:15:33.381 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T23:15:37.351 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:37.360 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:37.383 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:37.463 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-02T23:15:37.475 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-02T23:15:37.493 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-02T23:15:37.564 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-02T23:15:37.577 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-12-02T23:15:37.726 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com 2023-12-02T23:15:37.734 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-12-02T23:15:41.498 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T23:15:41.609 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-02T23:15:41.709 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-02T23:15:41.859 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-12-02T23:15:42.186 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds