2024-04-18T06:09:29.829 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T06:09:29.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:09:30.009 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc725953c10>, signals=[15]) 2024-04-18T06:09:30.009 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-04-18T06:09:30.009 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T06:09:30.010 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-18T06:09:30.031 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-04-18T06:09:30.032 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T06:09:30.032 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-18T06:09:30.056 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2024-04-18T06:09:30.056 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T06:09:30.056 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-18T06:09:30.154 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T06:09:30.183 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T06:09:30.202 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T06:09:30.209 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2024-04-18T06:09:30.261 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6 2024-04-18T06:09:30.364 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2024-04-18T06:09:30.860 INFO:teuthology.orchestra.console.smithi107:Power off 2024-04-18T06:09:30.860 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T06:09:30.884 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-04-18T06:09:30.884 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:30.912 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-18T06:09:30.938 INFO:teuthology.orchestra.console.smithi132:Power off 2024-04-18T06:09:30.938 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T06:09:30.955 INFO:teuthology.orchestra.console.smithi157:Power off 2024-04-18T06:09:30.955 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T06:09:30.965 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-04-18T06:09:30.965 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:30.977 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-04-18T06:09:30.977 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:30.985 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-18T06:09:31.000 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-04-18T06:09:31.013 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-04-18T06:09:31.086 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-04-18T06:09:31.100 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-04-18T06:09:31.113 INFO:teuthology.orchestra.console.smithi107:Power on 2024-04-18T06:09:31.114 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T06:09:31.135 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-04-18T06:09:31.135 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:31.159 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-18T06:09:31.187 INFO:teuthology.orchestra.console.smithi132:Power on 2024-04-18T06:09:31.187 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T06:09:31.201 INFO:teuthology.orchestra.console.smithi157:Power on 2024-04-18T06:09:31.201 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T06:09:31.215 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-04-18T06:09:31.215 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:31.233 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2024-04-18T06:09:31.234 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:31.251 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-18T06:09:31.282 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-04-18T06:09:35.162 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:35.253 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:35.272 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-18T06:09:35.282 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:35.363 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-18T06:09:35.391 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-04-18T06:09:39.276 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:39.365 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:39.385 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-04-18T06:09:39.392 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T06:09:39.486 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-04-18T06:09:39.500 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-04-18T06:09:39.533 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-18T06:09:39.587 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-04-18T06:09:39.602 INFO:teuthology.orchestra.console.smithi157:Power on completed 2024-04-18T06:09:39.634 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-04-18T06:09:39.703 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2024-04-18T06:09:39.735 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-04-18T06:14:43.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:14:47.038 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:14:53.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:14:56.126 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:15:02.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:05.182 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:15:11.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:14.242 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:15:20.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:23.326 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:15:29.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:32.386 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T06:15:38.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:59.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:15:59.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:02.558 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:02.590 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:08.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:08.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:11.618 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:11.646 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:17.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:17.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:20.702 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:20.703 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:26.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:26.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:29.758 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:29.759 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:35.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:35.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:38.395 WARNING:teuthology.provision.fog.smithi132:timed out 2024-04-18T06:16:38.814 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:38.850 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:44.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:44.626 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T06:16:44.627 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T06:16:44.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:44.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:44.879 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-04-18T06:16:44.879 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-04-18T06:16:44.897 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2024-04-18T06:16:44.897 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2024-04-18T06:16:44.955 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-04-18T06:16:44.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-18T06:16:45.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2024-04-18T06:16:45.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-04-18T06:16:45.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2024-04-18T06:16:45.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-18T06:16:45.284 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-18T06:16:45.340 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:16:45.341 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T06:16:45.342 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:16:45.342 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:16:45.342 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:16:45.342 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:16:45.343 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-04-18T06:16:45.344 DEBUG:teuthology.parallel:result is None 2024-04-18T06:16:47.874 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:16:47.902 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:16:53.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:53.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:16:56.958 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:17:02.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:04.034 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:17:06.018 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:17:10.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:12.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:13.118 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:17:15.102 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:17:19.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:21.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:22.174 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-18T06:17:28.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:29.227 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T06:17:29.228 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T06:17:39.618 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:17:45.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:48.702 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:17:49.493 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-04-18T06:17:49.493 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-04-18T06:17:49.513 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-04-18T06:17:49.513 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-04-18T06:17:49.570 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-04-18T06:17:49.570 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-04-18T06:17:49.702 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-04-18T06:17:49.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-04-18T06:17:49.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-04-18T06:17:49.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-04-18T06:17:49.930 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:17:49.988 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:17:49.989 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:17:49.989 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-04-18T06:17:49.990 DEBUG:teuthology.parallel:result is None 2024-04-18T06:17:54.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:17:57.758 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T06:18:03.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:18:04.230 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T06:18:04.230 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T06:18:20.095 INFO:teuthology.provision.fog.smithi157:Node is ready 2024-04-18T06:18:20.095 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2024-04-18T06:18:20.117 INFO:teuthology.orchestra.run.smithi157.stdout:smithi045 2024-04-18T06:18:20.117 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi045 /etc/hosts 2024-04-18T06:18:20.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T06:18:20.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi045/smithi157/g' /etc/hostname 2024-04-18T06:18:20.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-04-18T06:18:20.367 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:18:20.424 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:18:20.425 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:18:20.425 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2024-04-18T06:18:20.426 DEBUG:teuthology.parallel:result is None 2024-04-18T06:18:20.619 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-04-18T06:18:20.619 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T06:18:20.643 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-04-18T06:18:20.643 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T06:18:20.659 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2024-04-18T06:18:20.659 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T06:18:20.677 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-04-18T06:18:20.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-18T06:18:20.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:18:20.750 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-18T06:18:20.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-18T06:18:20.888 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-04-18T06:18:20.946 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-04-18T06:18:20.946 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-18T06:18:21.003 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-18T06:18:21.004 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:18:21.005 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:18:21.005 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:18:21.005 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:18:21.005 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-18T06:18:21.026 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-04-18T06:18:21.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T06:18:21.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:18:21.099 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-18T06:18:21.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T06:18:21.236 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-18T06:18:21.294 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-18T06:18:21.294 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-18T06:18:21.352 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:18:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:18:21.354 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:18:21.354 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:18:21.354 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-18T06:18:21.376 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2024-04-18T06:18:21.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T06:18:21.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T06:18:21.449 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-18T06:18:21.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T06:18:21.478 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-04-18T06:18:21.538 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-04-18T06:18:21.539 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-18T06:18:21.597 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T06:18:21.598 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T06:18:21.599 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T06:18:21.599 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T06:18:21.599 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-18T06:18:21.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:18:21.706 INFO:teuthology.dispatcher.supervisor:Running job 7661659 2024-04-18T06:18:21.707 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661659 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661659/orig.config.yaml 2024-04-18T06:18:21.713 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661659 2024-04-18T06:18:21.713 INFO:teuthology.dispatcher.supervisor:Job PID: 1914284 2024-04-18T06:18:21.714 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T06:20:21.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:22:21.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:24:22.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:26:22.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:28:22.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:30:22.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:32:22.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T06:32:22.890 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1