2023-12-19T05:10:47.922 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T05:10:47.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:10:48.089 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb9e423940>, signals=[15]) 2023-12-19T05:10:48.089 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-12-19T05:10:48.089 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:48.089 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-12-19T05:10:48.108 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-19T05:10:48.109 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:48.109 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-19T05:10:48.133 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-12-19T05:10:48.133 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:48.133 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-12-19T05:10:48.234 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:48.239 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:48.270 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:48.288 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6 2023-12-19T05:10:48.295 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6 2023-12-19T05:10:48.313 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6 2023-12-19T05:10:48.702 INFO:teuthology.orchestra.console.smithi123:Power off 2023-12-19T05:10:48.702 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:48.715 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-19T05:10:48.716 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:48.727 INFO:teuthology.orchestra.console.smithi177:Power off 2023-12-19T05:10:48.728 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:48.734 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:48.734 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:48.742 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:48.742 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:48.750 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:48.750 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:48.758 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-19T05:10:48.762 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-19T05:10:48.771 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-12-19T05:10:52.764 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:52.771 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:52.778 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:52.873 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-19T05:10:52.880 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-19T05:10:52.887 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-12-19T05:10:56.877 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.884 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.890 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.986 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-19T05:10:56.992 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-19T05:10:56.999 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-12-19T05:11:00.991 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:00.999 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:01.004 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:01.101 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-19T05:11:01.106 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T05:11:01.113 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-12-19T05:11:01.202 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-12-19T05:11:01.206 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-19T05:11:01.214 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-12-19T05:11:01.303 INFO:teuthology.orchestra.console.smithi123:Power on 2023-12-19T05:11:01.303 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:01.310 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-19T05:11:01.310 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:01.317 INFO:teuthology.orchestra.console.smithi177:Power on 2023-12-19T05:11:01.317 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:01.324 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:01.324 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:01.331 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:01.331 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:01.339 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:01.340 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:01.347 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-19T05:11:01.350 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T05:11:01.359 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-12-19T05:11:05.352 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.358 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.364 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.461 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-19T05:11:05.466 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T05:11:05.472 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-12-19T05:11:05.561 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-12-19T05:11:05.573 INFO:teuthology.orchestra.console.smithi177:Power on completed 2023-12-19T05:11:05.662 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-12-19T05:11:05.673 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-12-19T05:11:09.471 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:09.684 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-19T05:11:09.785 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-19T05:11:09.885 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-19T05:15:17.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:20.626 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:15:26.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:28.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:29.717 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:15:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:38.769 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:15:44.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:47.089 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:15:47.825 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:15:53.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:53.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:15:56.145 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:15:56.885 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:16:02.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:02.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:05.202 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:16:05.937 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-12-19T05:16:11.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:11.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:14.257 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:16:20.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:23.345 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:16:29.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:47.762 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:16:53.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:56.818 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:17:02.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:05.905 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-19T05:17:11.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:11.941 WARNING:teuthology.provision.fog.smithi177:timed out 2023-12-19T05:17:12.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:17:12.221 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:17:17.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:18.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:17:18.173 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:17:18.407 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-12-19T05:17:18.407 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-12-19T05:17:18.464 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177 2023-12-19T05:17:18.464 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177 /etc/hosts 2023-12-19T05:17:18.521 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-12-19T05:17:18.521 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-12-19T05:17:18.639 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hosts 2023-12-19T05:17:18.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-12-19T05:17:18.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hostname 2023-12-19T05:17:18.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-12-19T05:17:18.869 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-12-19T05:17:18.925 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-12-19T05:17:18.926 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:17:18.927 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:17:18.927 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:17:18.927 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:17:18.927 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-12-19T05:17:18.928 DEBUG:teuthology.parallel:result is None 2023-12-19T05:17:27.828 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-12-19T05:17:27.828 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-12-19T05:17:27.850 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-12-19T05:17:27.851 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-12-19T05:17:27.910 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-12-19T05:17:27.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-12-19T05:17:28.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-12-19T05:17:28.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-12-19T05:17:28.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-12-19T05:17:28.230 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-12-19T05:17:28.302 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-12-19T05:17:28.362 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:17:28.362 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:17:28.362 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-12-19T05:17:28.362 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:17:28.363 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:17:28.364 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-12-19T05:17:28.364 DEBUG:teuthology.parallel:result is None 2023-12-19T05:18:22.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:25.460 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:18:31.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:34.546 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:18:40.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:43.633 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:18:49.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:52.721 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:18:58.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:01.777 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:19:07.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:10.865 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-19T05:19:16.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:16.934 WARNING:teuthology.provision.fog.smithi174:timed out 2023-12-19T05:20:22.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:23.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:20:23.166 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:20:23.422 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-19T05:20:23.422 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-19T05:20:23.480 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174 2023-12-19T05:20:23.480 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174 /etc/hosts 2023-12-19T05:20:23.539 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-19T05:20:23.539 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-19T05:20:23.664 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hosts 2023-12-19T05:20:23.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-19T05:20:23.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hostname 2023-12-19T05:20:23.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-19T05:20:23.893 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-19T05:20:23.949 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:20:23.949 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:20:23.949 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-19T05:20:23.949 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:20:23.950 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:20:23.951 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:20:23.951 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-19T05:20:23.951 DEBUG:teuthology.parallel:result is None 2023-12-19T05:20:24.137 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-12-19T05:20:24.137 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:20:24.160 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-19T05:20:24.160 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:20:24.176 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-12-19T05:20:24.176 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:20:24.194 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:20:24.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-19T05:20:24.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:24.262 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-12-19T05:20:24.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-19T05:20:24.403 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-12-19T05:20:24.461 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-12-19T05:20:24.461 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:20:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:20:24.520 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:20:24.520 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-12-19T05:20:24.544 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:20:24.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-19T05:20:24.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:24.608 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-19T05:20:24.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-19T05:20:24.674 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-19T05:20:24.731 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-19T05:20:24.731 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-19T05:20:24.787 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:20:24.787 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:20:24.787 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-19T05:20:24.787 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:20:24.788 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:20:24.789 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-19T05:20:24.810 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:20:24.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-12-19T05:20:24.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:20:24.877 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-12-19T05:20:25.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-12-19T05:20:25.014 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-12-19T05:20:25.071 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-12-19T05:20:25.072 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:20:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:20:25.130 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:20:25.130 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-12-19T05:20:25.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:20:25.250 INFO:teuthology.dispatcher.supervisor:Running job 7495680 2023-12-19T05:20:25.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680 --name rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680/orig.config.yaml 2023-12-19T05:20:25.253 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680 2023-12-19T05:20:25.254 INFO:teuthology.dispatcher.supervisor:Job PID: 2034761 2023-12-19T05:20:25.254 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T05:22:25.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:24:25.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:26:25.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:28:25.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:30:26.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:32:26.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:34:26.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:36:26.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:38:26.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:40:26.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:42:27.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:44:27.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:44:27.329 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T05:44:27.463 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T05:44:27.463 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T05:44:27.510 DEBUG:teuthology.nuke:shortname: smithi123 2023-12-19T05:44:27.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:44:27.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:47.081236', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXXh7kgiTIDwBW83F6uz/WVJr1od8/qnaaq0gcBqYpCb22mN4s33lg2Ld0tK2W50U+pAhTrUfT5KZssUq08v14='} 2023-12-19T05:44:27.541 DEBUG:teuthology.nuke:shortname: smithi174 2023-12-19T05:44:27.541 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:44:27.562 DEBUG:teuthology.nuke:shortname: smithi177 2023-12-19T05:44:27.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:44:27.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:47.083174', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLELU0+XcoYg1hizu8WJHTx28PhBhiYz6jqJArJcF9qay89RJSOZmcesSGQl1thtZtz4UTATPXgtaXCNt4wZdPM='} 2023-12-19T05:44:27.596 INFO:teuthology.orchestra.console.smithi123:Power off 2023-12-19T05:44:27.596 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:44:27.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:47.085689', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzHC6zjYUaW2JOoHvbxN08R11mhFu7T+Q4TzmHrRwfauFh7IsbkW1utho+OQ0AwVJIzTILvyBvlDd157ZxvuIc='} 2023-12-19T05:44:27.616 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-12-19T05:44:27.616 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:44:27.639 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-19T05:44:27.639 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:44:27.648 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-19T05:44:27.659 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-19T05:44:27.659 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:44:27.672 INFO:teuthology.orchestra.console.smithi177:Power off 2023-12-19T05:44:27.673 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:44:27.684 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-19T05:44:27.696 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-12-19T05:44:27.696 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:44:27.717 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-12-19T05:44:27.749 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-12-19T05:44:27.785 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-19T05:44:27.818 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-12-19T05:44:27.903 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-12-19T05:44:27.927 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2023-12-19T05:44:27.960 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com