2023-12-19T13:17:10.915 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:17:10.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:17:11.095 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7facd75e1940>, signals=[15]) 2023-12-19T13:17:11.095 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2023-12-19T13:17:11.095 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:17:11.096 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2023-12-19T13:17:11.115 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-12-19T13:17:11.116 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:17:11.116 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-12-19T13:17:11.140 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-12-19T13:17:11.140 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:17:11.140 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-19T13:17:11.235 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:17:11.258 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:17:11.261 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:17:11.284 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.6 2023-12-19T13:17:11.303 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.6 2023-12-19T13:17:11.307 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.6 2023-12-19T13:17:11.532 INFO:teuthology.orchestra.console.smithi080:Power off 2023-12-19T13:17:11.533 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:17:11.545 INFO:teuthology.orchestra.console.smithi149:Power off 2023-12-19T13:17:11.545 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:17:11.556 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-19T13:17:11.556 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:17:11.565 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2023-12-19T13:17:11.565 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:11.573 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-12-19T13:17:11.573 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:11.581 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-19T13:17:11.581 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:11.589 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2023-12-19T13:17:11.593 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-12-19T13:17:11.603 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-19T13:17:15.595 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:15.601 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:15.608 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:15.704 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2023-12-19T13:17:15.709 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-12-19T13:17:15.716 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-19T13:17:19.708 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:19.716 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:19.724 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:19.819 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-12-19T13:17:19.826 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-12-19T13:17:19.833 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-19T13:17:19.920 INFO:teuthology.orchestra.console.smithi080:Power off completed 2023-12-19T13:17:19.934 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-19T13:17:20.021 INFO:teuthology.orchestra.console.smithi080:Power on 2023-12-19T13:17:20.021 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:17:20.035 INFO:teuthology.orchestra.console.smithi187:Power on 2023-12-19T13:17:20.036 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:17:20.045 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2023-12-19T13:17:20.046 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:20.059 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-12-19T13:17:20.059 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:20.070 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-12-19T13:17:20.083 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-19T13:17:23.829 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:23.938 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-12-19T13:17:24.039 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-12-19T13:17:24.071 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:24.084 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:24.140 INFO:teuthology.orchestra.console.smithi149:Power on 2023-12-19T13:17:24.141 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:17:24.161 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2023-12-19T13:17:24.161 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:24.181 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-12-19T13:17:24.184 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-12-19T13:17:24.192 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-19T13:17:28.185 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:28.192 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:28.199 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:17:28.295 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2023-12-19T13:17:28.301 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-12-19T13:17:28.306 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-19T13:17:28.396 INFO:teuthology.orchestra.console.smithi080:Power on completed 2023-12-19T13:17:28.401 INFO:teuthology.orchestra.console.smithi149:Power on completed 2023-12-19T13:17:28.407 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-12-19T13:17:28.497 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2023-12-19T13:17:28.502 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-12-19T13:17:28.507 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-12-19T13:19:59.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:19:59.536 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:20:14.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:14.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:17.586 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:20:17.586 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:20:23.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:23.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:26.641 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:20:26.642 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:20:32.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:32.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:35.697 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:20:35.698 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:20:41.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:41.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:44.760 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:20:44.760 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:20:50.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:50.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:53.845 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:20:53.846 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:20:59.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:59.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:02.901 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:21:02.929 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:21:03.539 WARNING:teuthology.provision.fog.smithi187:timed out 2023-12-19T13:21:08.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:08.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:09.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:11.985 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-12-19T13:21:12.593 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-19T13:21:17.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:18.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:21.649 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-19T13:21:27.313 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:21:27.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:30.709 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-19T13:21:33.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:36.369 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:21:36.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:39.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:21:39.142 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:21:42.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:45.425 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-12-19T13:21:51.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:21:52.054 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:21:52.054 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:21:59.393 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-12-19T13:21:59.393 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-12-19T13:21:59.414 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-12-19T13:21:59.415 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-12-19T13:21:59.475 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-12-19T13:21:59.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-19T13:21:59.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-12-19T13:21:59.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-12-19T13:21:59.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-12-19T13:21:59.788 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-19T13:21:59.853 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:21:59.910 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:21:59.911 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:21:59.912 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-12-19T13:21:59.913 DEBUG:teuthology.parallel:result is None 2023-12-19T13:22:08.022 INFO:teuthology.provision.fog.smithi080:Node is ready 2023-12-19T13:22:08.022 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2023-12-19T13:22:08.053 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2023-12-19T13:22:08.053 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2023-12-19T13:22:08.113 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2023-12-19T13:22:08.114 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2023-12-19T13:22:08.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2023-12-19T13:22:08.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2023-12-19T13:22:08.361 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2023-12-19T13:22:08.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2023-12-19T13:22:08.508 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2023-12-19T13:22:08.568 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:22:08.569 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:22:08.570 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:22:08.570 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2023-12-19T13:22:08.571 DEBUG:teuthology.parallel:result is None 2023-12-19T13:22:17.990 WARNING:teuthology.provision.fog.smithi149:timed out 2023-12-19T13:22:23.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:24.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:22:24.247 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:22:24.506 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-12-19T13:22:24.506 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-12-19T13:22:24.524 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149 2023-12-19T13:22:24.524 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149 /etc/hosts 2023-12-19T13:22:24.583 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-12-19T13:22:24.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-12-19T13:22:24.696 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149/smithi149/g' /etc/hosts 2023-12-19T13:22:24.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-12-19T13:22:24.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149/smithi149/g' /etc/hostname 2023-12-19T13:22:24.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-12-19T13:22:24.927 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-12-19T13:22:24.983 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:22:24.983 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:22:24.984 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:22:24.985 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:22:24.985 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:22:24.985 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-12-19T13:22:24.986 DEBUG:teuthology.parallel:result is None 2023-12-19T13:22:25.178 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2023-12-19T13:22:25.178 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:22:25.206 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-12-19T13:22:25.206 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:22:25.223 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-12-19T13:22:25.223 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:22:25.250 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:22:25.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2023-12-19T13:22:25.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:25.319 DEBUG:teuthology.orchestra.run.smithi080:> true 2023-12-19T13:22:25.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2023-12-19T13:22:25.394 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2023-12-19T13:22:25.452 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2023-12-19T13:22:25.453 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2023-12-19T13:22:25.510 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:22:25.510 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:22:25.510 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2023-12-19T13:22:25.510 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2023-12-19T13:22:25.510 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout: 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:22:25.511 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:22:25.512 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2023-12-19T13:22:25.531 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:22:25.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-12-19T13:22:25.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:25.600 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-12-19T13:22:25.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-12-19T13:22:25.669 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-12-19T13:22:25.728 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-12-19T13:22:25.729 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-12-19T13:22:25.787 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:22:25.787 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:22:25.787 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:22:25.788 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:22:25.789 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-12-19T13:22:25.814 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:22:25.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-19T13:22:25.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:25.885 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-19T13:22:25.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-19T13:22:25.982 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-12-19T13:22:26.038 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-12-19T13:22:26.039 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-19T13:22:26.095 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:22:26.096 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:22:26.097 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:22:26.097 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:22:26.097 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-19T13:22:26.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:22:26.216 INFO:teuthology.dispatcher.supervisor:Running job 7496754 2023-12-19T13:22:26.216 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754/orig.config.yaml 2023-12-19T13:22:26.219 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754 2023-12-19T13:22:26.219 INFO:teuthology.dispatcher.supervisor:Job PID: 1080033 2023-12-19T13:22:26.219 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:24:26.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:26:26.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:28:26.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:30:26.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:32:26.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:34:26.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:36:26.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:38:26.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:38:26.779 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T13:38:26.930 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T13:38:26.930 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T13:38:26.989 DEBUG:teuthology.nuke:shortname: smithi080 2023-12-19T13:38:26.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:38:27.014 DEBUG:teuthology.nuke:shortname: smithi149 2023-12-19T13:38:27.015 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:38:27.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:17:10.036505', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBEwiXhIioN+n1KJ6mT08XSh3MyW4MyJnkb6IPweam3m//t2CNmSU64z3yVGgiQTVLpvcQeMSmGobNSvmJLMVXw='} 2023-12-19T13:38:27.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:17:10.032774', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB86qt7lO32E9ECoN7p5RA5QGaz2CL7s3IxcBwrshf8E5mS50hUkq1QIUcc8pE+OIEVzjM0J8ZKxBIpF2ihTAO8='} 2023-12-19T13:38:27.040 DEBUG:teuthology.nuke:shortname: smithi187 2023-12-19T13:38:27.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:38:27.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:17:10.034732', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwkguZ5Y2zCCb1qCgvEbhG8JB5cfQQiN3JYOAQVex+n7gEPc34kBFFir04oLscG2aRr2zkijM4Q25bUjGUUPhg='} 2023-12-19T13:38:27.071 INFO:teuthology.orchestra.console.smithi080:Power off 2023-12-19T13:38:27.071 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:38:27.093 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2023-12-19T13:38:27.093 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:38:27.109 INFO:teuthology.orchestra.console.smithi149:Power off 2023-12-19T13:38:27.109 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:38:27.123 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-12-19T13:38:27.133 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-12-19T13:38:27.133 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:38:27.152 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-19T13:38:27.152 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:38:27.161 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-12-19T13:38:27.176 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-19T13:38:27.177 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:38:27.199 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-19T13:38:27.223 INFO:teuthology.orchestra.console.smithi080:Power off completed 2023-12-19T13:38:27.262 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-12-19T13:38:27.300 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-19T13:38:27.378 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2023-12-19T13:38:27.412 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-12-19T13:38:27.443 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com