2023-12-16T00:47:34.272 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T00:47:34.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:47:34.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e089cd940>, signals=[15]) 2023-12-16T00:47:34.443 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-12-16T00:47:34.443 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:47:34.444 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-12-16T00:47:34.467 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-12-16T00:47:34.468 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:47:34.468 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-16T00:47:34.492 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-12-16T00:47:34.492 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:47:34.492 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-16T00:47:34.589 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:47:34.619 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:47:34.634 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:47:34.643 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2023-12-16T00:47:34.674 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2023-12-16T00:47:34.684 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.6 2023-12-16T00:47:34.912 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-16T00:47:34.912 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:47:34.935 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-16T00:47:34.935 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:34.947 INFO:teuthology.orchestra.console.smithi107:Power off 2023-12-16T00:47:34.947 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:47:34.960 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-16T00:47:34.960 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:47:34.968 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-16T00:47:34.969 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-12-16T00:47:34.969 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:34.981 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-16T00:47:34.982 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:34.990 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T00:47:35.003 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T00:47:38.973 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:38.990 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:39.004 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:39.082 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-16T00:47:39.098 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T00:47:39.111 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T00:47:43.087 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:43.098 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:43.112 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:43.196 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-16T00:47:43.206 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T00:47:43.220 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T00:47:43.297 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-16T00:47:43.398 INFO:teuthology.orchestra.console.smithi157:Power on 2023-12-16T00:47:43.398 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:47:43.419 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-12-16T00:47:43.419 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:43.439 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-16T00:47:47.211 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:47.221 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:47.320 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-16T00:47:47.329 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-16T00:47:47.421 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-12-16T00:47:47.429 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-16T00:47:47.440 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:47.522 INFO:teuthology.orchestra.console.smithi107:Power on 2023-12-16T00:47:47.522 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:47:47.530 INFO:teuthology.orchestra.console.smithi141:Power on 2023-12-16T00:47:47.530 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:47:47.543 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-12-16T00:47:47.543 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:47.550 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-12-16T00:47:47.550 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:47.557 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-16T00:47:47.564 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-16T00:47:47.571 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-16T00:47:51.561 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:51.568 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:51.575 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:51.670 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-16T00:47:51.677 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-16T00:47:51.683 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-16T00:47:51.771 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-12-16T00:47:51.777 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-12-16T00:47:51.872 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-12-16T00:47:51.878 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-12-16T00:47:55.685 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:47:55.795 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-16T00:47:55.895 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-12-16T00:47:55.996 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-12-16T00:50:26.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:50:27.836 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-16T00:50:37.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:50:40.881 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:50:46.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:50:49.941 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:50:52.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:50:55.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:50:55.953 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:50:58.997 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:51:01.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:04.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:05.009 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:08.053 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:51:11.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:14.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:14.069 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:17.109 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:51:20.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:23.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:23.121 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:26.161 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:51:29.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:31.839 WARNING:teuthology.provision.fog.smithi141:timed out 2023-12-16T00:51:32.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:32.177 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:35.221 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-16T00:51:37.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:38.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:41.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:41.237 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:47.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:50.289 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:51:56.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:51:56.305 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-16T00:51:59.349 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:52:02.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:52:05.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:52:05.365 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-16T00:52:08.401 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-16T00:52:11.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:52:11.658 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:52:11.659 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:52:14.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:52:27.695 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-12-16T00:52:27.695 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-12-16T00:52:27.716 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-12-16T00:52:27.717 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-12-16T00:52:27.775 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-12-16T00:52:27.775 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-16T00:52:27.895 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-12-16T00:52:27.924 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-12-16T00:52:27.991 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-12-16T00:52:28.059 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-16T00:52:28.126 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-16T00:52:28.183 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T00:52:28.184 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:52:28.185 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:52:28.185 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:52:28.185 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:52:28.185 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-12-16T00:52:28.187 DEBUG:teuthology.parallel:result is None 2023-12-16T00:52:41.228 WARNING:teuthology.provision.fog.smithi107:timed out 2023-12-16T00:52:47.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:52:47.502 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:52:47.503 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:52:47.754 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-12-16T00:52:47.754 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-12-16T00:52:47.772 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-12-16T00:52:47.773 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-12-16T00:52:47.830 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-12-16T00:52:47.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-12-16T00:52:47.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-12-16T00:52:47.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-12-16T00:52:48.035 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-12-16T00:52:48.103 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-12-16T00:52:48.170 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:52:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:52:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:52:48.228 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-12-16T00:52:48.229 DEBUG:teuthology.parallel:result is None 2023-12-16T00:53:14.406 WARNING:teuthology.provision.fog.smithi157:timed out 2023-12-16T00:53:20.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:53:20.639 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:53:20.640 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:53:20.897 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-12-16T00:53:20.897 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-12-16T00:53:20.915 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-12-16T00:53:20.915 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-12-16T00:53:20.972 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-12-16T00:53:20.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-16T00:53:21.084 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-12-16T00:53:21.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-12-16T00:53:21.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-12-16T00:53:21.248 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-16T00:53:21.314 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-16T00:53:21.371 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:53:21.372 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:53:21.372 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-12-16T00:53:21.373 DEBUG:teuthology.parallel:result is None 2023-12-16T00:53:21.561 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-12-16T00:53:21.561 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:53:21.584 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-12-16T00:53:21.584 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:53:21.600 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-12-16T00:53:21.600 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:53:21.619 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:53:21.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T00:53:21.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:53:21.689 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-12-16T00:53:21.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-16T00:53:21.785 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-12-16T00:53:21.843 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-12-16T00:53:21.843 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-12-16T00:53:21.901 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:53:21.902 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:53:21.903 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:53:21.903 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:53:21.903 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-12-16T00:53:21.925 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:53:21.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T00:53:21.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:53:21.995 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-12-16T00:53:22.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-16T00:53:22.136 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-12-16T00:53:22.195 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-12-16T00:53:22.195 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:53:22.254 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:53:22.255 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:53:22.255 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-16T00:53:22.276 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:53:22.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T00:53:22.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:53:22.343 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-16T00:53:22.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-16T00:53:22.411 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-16T00:53:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-16T00:53:22.470 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-16T00:53:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:53:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:53:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:53:22.528 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-16T00:53:22.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:53:22.649 INFO:teuthology.dispatcher.supervisor:Running job 7493413 2023-12-16T00:53:22.650 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413 --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413/orig.config.yaml 2023-12-16T00:53:22.655 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413 2023-12-16T00:53:22.655 INFO:teuthology.dispatcher.supervisor:Job PID: 2591561 2023-12-16T00:53:22.655 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T00:55:22.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:57:22.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:59:22.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:01:22.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:01:22.996 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-16T01:01:23.167 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T01:01:23.167 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T01:01:23.220 DEBUG:teuthology.nuke:shortname: smithi107 2023-12-16T01:01:23.220 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:01:23.241 DEBUG:teuthology.nuke:shortname: smithi141 2023-12-16T01:01:23.241 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:01:23.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:47:33.370704', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNrx6FYlmBxq97qdNlf2xHv1NYC6jABV6+QxGwT/V+HbA7RZ+KHMi8M9C3Zmf012vfvLg/jcG3CWGgoVmKc9T+8='} 2023-12-16T01:01:23.256 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-16T01:01:23.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T01:01:23.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:47:33.365869', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF1I2RU3F3Q2E3qtp+EMsFRuY46XKChdD6A8kgThRWippftXQPKyDB6fL7M/RsWOVjhIjpekXvqfbHP5KLdcaUY='} 2023-12-16T01:01:23.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:47:33.368248', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRI6ODKvVUW7CRcxb0Q6pLA+vuS3HNRiXtihPPxZ3/jpBHFKz+t8y8wwNexy/BZARKdiARSQkM4SDtMSf65Lu8='} 2023-12-16T01:01:23.287 INFO:teuthology.orchestra.console.smithi107:Power off 2023-12-16T01:01:23.287 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T01:01:23.309 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-12-16T01:01:23.310 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T01:01:23.322 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-16T01:01:23.323 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T01:01:23.337 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-16T01:01:23.337 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T01:01:23.343 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-16T01:01:23.345 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-16T01:01:23.345 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T01:01:23.357 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-16T01:01:23.357 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T01:01:23.367 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-16T01:01:23.380 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-16T01:01:23.445 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-12-16T01:01:23.468 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-16T01:01:23.481 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-16T01:01:23.593 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-12-16T01:01:23.619 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-12-16T01:01:23.727 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com