2024-04-18T13:20:14.480 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T13:20:14.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:20:14.680 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffaf4570c10>, signals=[15]) 2024-04-18T13:20:14.681 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-04-18T13:20:14.681 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T13:20:14.681 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-18T13:20:14.704 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2024-04-18T13:20:14.704 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T13:20:14.704 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-18T13:20:14.735 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2024-04-18T13:20:14.735 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T13:20:14.735 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-18T13:20:14.760 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-04-18T13:20:14.760 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T13:20:14.760 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-04-18T13:20:14.816 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T13:20:14.846 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T13:20:14.869 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T13:20:14.876 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 22.04 2024-04-18T13:20:14.885 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-18T13:20:14.888 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 22.04 2024-04-18T13:20:14.916 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04 2024-04-18T13:20:14.932 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of ubuntu 22.04 2024-04-18T13:20:14.948 DEBUG:teuthology.provision.fog.smithi006:Canceling deploy task with ID 971352 2024-04-18T13:20:14.956 DEBUG:teuthology.provision.fog.smithi082:Canceling deploy task with ID 971353 2024-04-18T13:20:15.252 INFO:teuthology.orchestra.console.smithi196:Power off 2024-04-18T13:20:15.252 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:20:15.264 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-18T13:20:15.265 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:20:15.272 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-04-18T13:20:15.273 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.293 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-18T13:20:15.293 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.300 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-04-18T13:20:15.315 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-18T13:20:15.327 INFO:teuthology.orchestra.console.smithi006:Power off 2024-04-18T13:20:15.327 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:20:15.340 INFO:teuthology.orchestra.console.smithi082:Power off 2024-04-18T13:20:15.341 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:20:15.352 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-04-18T13:20:15.353 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.362 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-04-18T13:20:15.362 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.373 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T13:20:15.384 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-18T13:20:15.401 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-04-18T13:20:15.416 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-18T13:20:15.474 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-04-18T13:20:15.485 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-04-18T13:20:15.502 INFO:teuthology.orchestra.console.smithi196:Power on 2024-04-18T13:20:15.502 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T13:20:15.516 INFO:teuthology.orchestra.console.smithi111:Power on 2024-04-18T13:20:15.517 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T13:20:15.525 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-04-18T13:20:15.525 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.541 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-04-18T13:20:15.542 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.549 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-04-18T13:20:15.563 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-18T13:20:15.575 INFO:teuthology.orchestra.console.smithi006:Power on 2024-04-18T13:20:15.575 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T13:20:15.586 INFO:teuthology.orchestra.console.smithi082:Power on 2024-04-18T13:20:15.586 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T13:20:15.599 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-04-18T13:20:15.599 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.607 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2024-04-18T13:20:15.607 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:15.621 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T13:20:15.627 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-18T13:20:19.554 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:19.563 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:19.622 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:19.629 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:19.664 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-18T13:20:19.672 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T13:20:19.732 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-18T13:20:19.737 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-18T13:20:19.765 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-04-18T13:20:19.772 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-04-18T13:20:19.866 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-04-18T13:20:19.873 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2024-04-18T13:20:23.736 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:23.744 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:20:23.853 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-18T13:20:23.882 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-18T13:20:23.954 INFO:teuthology.orchestra.console.smithi082:Power on completed 2024-04-18T13:20:23.983 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-04-18T13:20:24.055 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2024-04-18T13:20:24.084 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-04-18T13:23:25.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:23:25.369 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T13:23:36.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:23:39.358 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:23:45.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:23:48.414 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:23:54.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:23:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:23:57.470 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:24:03.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:06.526 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:24:12.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:15.582 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:24:21.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:21.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:24.510 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:24:24.638 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:24:29.372 WARNING:teuthology.provision.fog.smithi006:timed out 2024-04-18T13:24:30.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:30.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:33.566 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:24:35.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:39.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:42.622 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:24:48.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:51.678 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:24:53.918 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-18T13:24:55.400 WARNING:teuthology.provision.fog.smithi082:timed out 2024-04-18T13:24:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:24:59.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:00.734 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:25:00.927 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-18T13:25:01.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:02.111 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:25:06.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:06.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:06.930 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-18T13:25:08.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:08.114 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:25:09.794 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:25:12.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:12.933 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-18T13:25:14.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:14.117 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:25:15.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:18.846 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:25:18.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:20.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:20.121 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-18T13:25:24.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:26.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:26.309 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T13:25:26.309 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T13:25:26.849 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-04-18T13:25:26.849 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-04-18T13:25:26.895 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-04-18T13:25:26.895 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-04-18T13:25:26.943 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-04-18T13:25:26.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-04-18T13:25:27.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-04-18T13:25:27.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-04-18T13:25:27.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-04-18T13:25:27.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-04-18T13:25:27.257 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-04-18T13:25:27.303 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:25:27.303 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-04-18T13:25:27.303 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:25:27.304 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:25:27.305 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-04-18T13:25:27.306 DEBUG:teuthology.parallel:result is None 2024-04-18T13:25:27.902 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-18T13:25:32.834 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:25:33.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:34.581 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T13:25:34.581 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T13:25:35.054 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-04-18T13:25:35.055 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-04-18T13:25:35.102 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-04-18T13:25:35.102 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-04-18T13:25:35.150 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-04-18T13:25:35.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-18T13:25:35.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-04-18T13:25:35.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-04-18T13:25:35.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-04-18T13:25:35.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-18T13:25:35.469 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-18T13:25:35.514 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:25:35.514 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:25:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:25:35.515 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-04-18T13:25:35.516 DEBUG:teuthology.parallel:result is None 2024-04-18T13:25:38.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:38.838 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:25:44.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:50.942 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:25:56.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:25:57.086 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:03.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:03.234 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:09.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:09.374 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:15.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:15.518 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:21.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:21.662 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:27.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:27.806 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:33.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:33.906 WARNING:teuthology.provision.fog.smithi111:timed out 2024-04-18T13:26:33.950 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:39.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:39.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:40.094 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:40.133 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T13:26:40.133 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T13:26:40.590 INFO:teuthology.provision.fog.smithi111:Node is ready 2024-04-18T13:26:40.590 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2024-04-18T13:26:40.638 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2024-04-18T13:26:40.638 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2024-04-18T13:26:40.686 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2024-04-18T13:26:40.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-18T13:26:40.806 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2024-04-18T13:26:40.820 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2024-04-18T13:26:40.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2024-04-18T13:26:40.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-04-18T13:26:40.989 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T13:26:41.038 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-18T13:26:41.039 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2024-04-18T13:26:41.039 DEBUG:teuthology.parallel:result is None 2024-04-18T13:26:46.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:46.238 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:52.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:52.382 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:26:58.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:26:58.527 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:04.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:04.674 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:10.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:10.814 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:16.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:16.958 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:22.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:23.102 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:29.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:29.246 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:35.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:38.302 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:44.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:47.358 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:27:53.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:27:56.414 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:02.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:05.470 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:11.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:14.526 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:20.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:23.582 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:29.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:32.638 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:38.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:41.694 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:47.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:50.750 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:28:56.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:28:59.806 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:05.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:08.862 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:14.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:17.918 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:23.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:26.974 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:32.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:36.030 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:42.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:45.086 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:29:51.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:29:54.146 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:00.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:03.230 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:09.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:12.286 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:18.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:21.342 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:27.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:30.402 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:36.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:39.454 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:45.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:48.514 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:30:54.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:30:57.566 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:03.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:06.622 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:12.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:15.683 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:21.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:24.734 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:30.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:33.854 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:39.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:42.910 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:48.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:31:51.970 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:31:57.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:01.026 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:07.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:10.078 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:16.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:19.138 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:25.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:28.190 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:34.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:37.249 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:43.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:46.302 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:32:52.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:32:55.358 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:01.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:04.414 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:10.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:13.470 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:19.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:22.526 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:28.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:31.582 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:37.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:40.638 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:46.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:49.698 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:33:55.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:33:58.754 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:04.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:07.806 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:13.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:16.866 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:22.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:25.922 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:31.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:34.974 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:40.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:44.030 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:50.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:34:53.086 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:34:59.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:02.142 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:08.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:11.198 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:17.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:20.254 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:26.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:29.310 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:35.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:38.366 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:44.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:47.422 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:35:53.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:35:56.478 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:02.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:05.534 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:11.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:14.590 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:20.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:23.646 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:29.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:32.702 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:38.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:41.758 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:47.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:50.814 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:36:56.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:36:59.870 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:05.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:08.926 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:14.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:17.982 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:23.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:27.038 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:33.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:36.094 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:42.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:45.150 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:37:51.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:37:54.206 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:00.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:03.262 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:09.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:12.318 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:18.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:21.374 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:27.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:30.430 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:36.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:39.487 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:45.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:48.542 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:38:54.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:38:57.598 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:39:03.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:39:06.654 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:39:12.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:39:15.710 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:39:21.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:39:24.766 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:39:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T13:39:33.823 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-18T13:39:33.826 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2024-04-18T13:39:33.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T13:39:34.109 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2faa7cfca11c4e439f5701d701895aa9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2024-04-18T13:39:34.111 INFO:teuthology.nuke:Checking targets against current locks 2024-04-18T13:39:34.141 INFO:teuthology.nuke:Not nuking smithi006.front.sepia.ceph.com because description doesn't match: nmordech-2024-04-18_13:06:18-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi != None 2024-04-18T13:39:34.159 INFO:teuthology.nuke:Not nuking smithi082.front.sepia.ceph.com because description doesn't match: nmordech-2024-04-18_13:06:18-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi != None 2024-04-18T13:39:34.195 DEBUG:teuthology.nuke:shortname: smithi111 2024-04-18T13:39:34.195 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T13:39:34.214 DEBUG:teuthology.nuke:shortname: smithi196 2024-04-18T13:39:34.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T13:39:34.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2024-04-18_13:06:18-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7662062', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 13:20:13.349322', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIl72qqW3sUA5Uufvgwe9UIcrWUeghvHbq9erfuJ1TPscIGEaLTaSPJFLQRR8ySQuN/YYbTzr+TNay+f6P0HlkQ='} 2024-04-18T13:39:34.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2024-04-18_13:06:18-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7662062', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 13:20:13.350389', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNVa/i4FlkIajOaR1ISuu55hJrLx8I/6UShIxEsKF3CYFifjmbbgmsW30S+aIGd2vPDsYTIXwImfDXMhv1VmQeY='} 2024-04-18T13:39:34.276 INFO:teuthology.orchestra.console.smithi196:Power off 2024-04-18T13:39:34.277 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:39:34.291 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-18T13:39:34.292 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T13:39:34.302 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-04-18T13:39:34.303 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:34.313 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-18T13:39:34.313 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:34.325 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-18T13:39:34.335 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T13:39:38.326 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:38.336 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:38.436 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-18T13:39:38.444 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-18T13:39:42.437 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:42.444 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T13:39:42.546 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-04-18T13:39:42.553 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-18T13:39:42.648 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-04-18T13:39:42.655 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-18T13:39:42.796 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2024-04-18T13:39:42.805 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2024-04-18T13:39:42.806 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEBl30gMaMH3FHl1goS2ELo1xY5gyySlSpC8Cs14w3dniz5fE7PJHqrX2lQITf5yMgu8AzHlS4eCcYqRurQjLcg= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxzBI+hGhvsIFDSvnRGNyLOPqxiK7rioRz+4cSM8YXj/jCh6i8Mn6HSsxsc8bibwXZG/K2X72FojBa3CMLuMdo= 2024-04-18T13:39:43.292 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/provision/fog.py", line 275, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds