2023-12-19T13:08:53.718 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:08:53.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:08:53.889 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f309585d940>, signals=[15]) 2023-12-19T13:08:53.889 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-12-19T13:08:53.890 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:08:53.890 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-19T13:08:53.915 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-12-19T13:08:53.915 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:08:53.915 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-19T13:08:53.940 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-19T13:08:53.940 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:08:53.940 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-19T13:08:54.015 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:08:54.040 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:08:54.056 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2023-12-19T13:08:54.081 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:08:54.086 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-12-19T13:08:54.130 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2023-12-19T13:08:54.363 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-19T13:08:54.364 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:08:54.380 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-19T13:08:54.381 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:08:54.394 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-19T13:08:54.395 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:54.403 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-19T13:08:54.403 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:54.417 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-19T13:08:54.429 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-19T13:08:54.429 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:08:54.438 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T13:08:54.452 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-19T13:08:54.452 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:54.474 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-19T13:08:58.421 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:58.439 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:58.476 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:08:58.531 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-19T13:08:58.549 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T13:08:58.584 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-19T13:09:02.535 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:02.550 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:02.586 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:02.644 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-19T13:09:02.659 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T13:09:02.695 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-19T13:09:02.760 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-19T13:09:02.796 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-19T13:09:02.861 INFO:teuthology.orchestra.console.smithi157:Power on 2023-12-19T13:09:02.861 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:09:02.882 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-12-19T13:09:02.882 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:02.897 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-19T13:09:02.897 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:09:02.905 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T13:09:02.918 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-19T13:09:02.918 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:02.940 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-19T13:09:06.649 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:06.758 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-19T13:09:06.859 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-19T13:09:06.906 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:06.941 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:06.960 INFO:teuthology.orchestra.console.smithi175:Power on 2023-12-19T13:09:06.960 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:09:06.982 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-12-19T13:09:06.982 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:07.003 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-19T13:09:07.016 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T13:09:07.051 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-19T13:09:11.005 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:11.017 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:11.052 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:09:11.114 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-19T13:09:11.161 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-19T13:09:11.190 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T13:09:11.215 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-12-19T13:09:11.262 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-19T13:09:11.291 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-12-19T13:09:11.316 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-12-19T13:09:11.363 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-19T13:09:11.392 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-12-19T13:11:57.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:11:57.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:00.690 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-19T13:12:00.690 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:06.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:06.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:09.749 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-19T13:12:09.750 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:12.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:15.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:15.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:15.797 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:12:18.833 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-19T13:12:18.834 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:21.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:24.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:24.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:24.885 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:12:27.889 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-19T13:12:27.890 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:30.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:33.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:33.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:33.969 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:12:36.977 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-19T13:12:36.978 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:39.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:42.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:42.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:43.026 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:12:46.033 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-19T13:12:49.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:52.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:12:52.085 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:12:58.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:01.169 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:13:07.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:10.229 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:13:16.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:19.317 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:13:25.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:43.002 WARNING:teuthology.provision.fog.smithi175:timed out 2023-12-19T13:13:43.701 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:13:49.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:49.256 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:13:49.256 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:13:49.512 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-12-19T13:13:49.512 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-12-19T13:13:49.530 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-12-19T13:13:49.530 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-12-19T13:13:49.589 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-12-19T13:13:49.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-19T13:13:49.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:49.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-12-19T13:13:49.740 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-12-19T13:13:49.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-12-19T13:13:49.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-19T13:13:49.943 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-19T13:13:49.999 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:13:49.999 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:13:49.999 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:13:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:13:50.001 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:13:50.001 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-12-19T13:13:50.003 DEBUG:teuthology.parallel:result is None 2023-12-19T13:13:52.041 WARNING:teuthology.provision.fog.smithi195:timed out 2023-12-19T13:13:52.753 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:13:58.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:58.330 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:13:58.330 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:13:58.608 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-19T13:13:58.608 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-19T13:13:58.627 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-12-19T13:13:58.627 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-12-19T13:13:58.684 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-12-19T13:13:58.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-19T13:13:58.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:13:58.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-12-19T13:13:58.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-12-19T13:13:58.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-12-19T13:13:58.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-19T13:13:59.021 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-12-19T13:13:59.075 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:13:59.076 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:13:59.077 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-12-19T13:13:59.077 DEBUG:teuthology.parallel:result is None 2023-12-19T13:14:01.809 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T13:14:07.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:14:08.385 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:14:08.385 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:14:24.440 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-12-19T13:14:24.441 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-12-19T13:14:24.462 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-12-19T13:14:24.462 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-12-19T13:14:24.520 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-12-19T13:14:24.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-19T13:14:24.640 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-12-19T13:14:24.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-12-19T13:14:24.736 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-12-19T13:14:24.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-19T13:14:24.871 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-19T13:14:24.928 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-19T13:14:24.929 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:14:24.930 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:14:24.930 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:14:24.930 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:14:24.930 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-12-19T13:14:24.930 DEBUG:teuthology.parallel:result is None 2023-12-19T13:14:25.118 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-12-19T13:14:25.119 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:14:25.144 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-12-19T13:14:25.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:14:25.160 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-12-19T13:14:25.161 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:14:25.178 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:14:25.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-19T13:14:25.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:14:25.245 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-19T13:14:25.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-19T13:14:25.315 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-19T13:14:25.371 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-19T13:14:25.372 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-19T13:14:25.428 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:14:25.429 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:14:25.430 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-19T13:14:25.452 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:14:25.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-19T13:14:25.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:14:25.522 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-12-19T13:14:25.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-19T13:14:25.659 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-12-19T13:14:25.717 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-12-19T13:14:25.717 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-19T13:14:25.775 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:14:25.775 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:14:25.775 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-12-19T13:14:25.775 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-12-19T13:14:25.775 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:14:25.776 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:14:25.777 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-19T13:14:25.802 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:14:25.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-19T13:14:25.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:14:25.872 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-19T13:14:26.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-19T13:14:26.016 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-19T13:14:26.074 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-19T13:14:26.074 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:14:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:14:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:14:26.133 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-19T13:14:26.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:14:26.272 INFO:teuthology.dispatcher.supervisor:Running job 7496738 2023-12-19T13:14:26.272 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738/orig.config.yaml 2023-12-19T13:14:26.275 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738 2023-12-19T13:14:26.275 INFO:teuthology.dispatcher.supervisor:Job PID: 988656 2023-12-19T13:14:26.275 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:16:26.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:18:26.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:20:26.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:22:26.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:24:27.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:26:27.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:28:27.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:30:27.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:30:27.642 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T13:30:27.788 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T13:30:27.789 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T13:30:27.840 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-19T13:30:27.841 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:30:27.868 DEBUG:teuthology.nuke:shortname: smithi175 2023-12-19T13:30:27.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:30:27.871 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:08:52.816214', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCzD6+f1C09Wdto/uzha+egoh0zEodB1hII4ohpigTg9G56zr54nYRvKuvWvJd2tQQ/LyOHNZEDtQXSUZAQUa0='} 2023-12-19T13:30:27.897 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-19T13:30:27.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:30:27.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:08:52.814358', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHntoyGJ07C9u7kBJA5jnrsKElB5HXk4NxtLX+R9deIneKJJ6Zy+X9OwX0Z4oEdgfpfCpEKR97Olw4h+sPkCfSo='} 2023-12-19T13:30:27.916 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-19T13:30:27.916 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:30:27.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:08:52.817287', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKI0qsWUwwaBJQ7EpX9NXOq30lrxBexZZkWf5oC7bJrbvFe0mB94fzLURSbNU+EvwmCr/jyFHByyja4II9AJYns='} 2023-12-19T13:30:27.938 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-19T13:30:27.938 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:30:27.955 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-19T13:30:27.956 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:30:27.968 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T13:30:27.977 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-19T13:30:27.977 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:30:27.993 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-19T13:30:27.994 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:30:28.003 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-19T13:30:28.015 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-19T13:30:28.015 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:30:28.037 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-19T13:30:28.070 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-19T13:30:28.104 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-19T13:30:28.138 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-19T13:30:28.232 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-12-19T13:30:28.249 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com 2023-12-19T13:30:28.282 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com