2024-01-11T14:16:16.243 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-11T14:16:16.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:16:16.430 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7972be3c10>, signals=[15]) 2024-01-11T14:16:16.431 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2024-01-11T14:16:16.431 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T14:16:16.431 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-01-11T14:16:16.459 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-01-11T14:16:16.460 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T14:16:16.460 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-01-11T14:16:16.484 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2024-01-11T14:16:16.484 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T14:16:16.484 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-01-11T14:16:16.599 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T14:16:16.603 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T14:16:16.620 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T14:16:16.640 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2024-01-11T14:16:16.662 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of rhel 8.6 2024-01-11T14:16:16.677 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6 2024-01-11T14:16:16.892 INFO:teuthology.orchestra.console.smithi113:Power off 2024-01-11T14:16:16.893 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T14:16:16.906 INFO:teuthology.orchestra.console.smithi142:Power off 2024-01-11T14:16:16.906 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T14:16:16.920 INFO:teuthology.orchestra.console.smithi167:Power off 2024-01-11T14:16:16.920 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T14:16:16.929 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-01-11T14:16:16.929 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:16.936 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-01-11T14:16:16.936 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:16.944 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-01-11T14:16:16.945 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:16.952 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-11T14:16:16.959 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-01-11T14:16:16.964 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-01-11T14:16:20.956 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:20.966 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:20.972 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:21.069 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-11T14:16:21.074 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-01-11T14:16:21.081 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-01-11T14:16:25.074 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.081 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.088 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.183 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-11T14:16:25.189 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-01-11T14:16:25.196 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-11T14:16:25.284 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-01-11T14:16:25.290 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-01-11T14:16:25.297 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-01-11T14:16:25.386 INFO:teuthology.orchestra.console.smithi142:Power on 2024-01-11T14:16:25.386 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T14:16:25.393 INFO:teuthology.orchestra.console.smithi113:Power on 2024-01-11T14:16:25.393 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T14:16:25.399 INFO:teuthology.orchestra.console.smithi167:Power on 2024-01-11T14:16:25.400 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T14:16:25.406 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-01-11T14:16:25.406 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.413 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-01-11T14:16:25.413 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.420 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2024-01-11T14:16:25.421 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:25.428 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-11T14:16:25.432 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-01-11T14:16:25.441 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-11T14:16:29.433 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:29.440 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:29.446 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:29.542 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-11T14:16:29.548 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-01-11T14:16:29.554 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-11T14:16:33.547 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:33.553 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:33.558 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T14:16:33.665 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-01-11T14:16:33.722 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-11T14:16:33.759 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-01-11T14:16:33.766 INFO:teuthology.orchestra.console.smithi167:Power on completed 2024-01-11T14:16:33.823 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-01-11T14:16:33.860 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-01-11T14:16:33.867 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2024-01-11T14:16:33.924 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-01-11T14:16:33.961 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2024-01-11T14:19:19.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:19.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:35.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:38.432 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-11T14:19:38.432 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:19:44.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:44.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:47.516 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-11T14:19:47.516 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:19:53.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:53.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:19:53.532 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:19:56.608 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-11T14:19:56.608 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:19:59.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:02.588 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:02.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:02.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:05.660 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-11T14:20:05.692 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:20:08.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:11.644 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:11.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:11.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:14.752 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:20:17.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:20.700 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:20.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:23.804 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-11T14:20:26.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:29.756 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:29.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:35.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:38.812 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:44.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:20:47.868 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-01-11T14:20:53.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:21:01.647 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T14:21:01.648 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T14:21:11.663 WARNING:teuthology.provision.fog.smithi142:timed out 2024-01-11T14:21:17.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:21:17.921 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T14:21:17.921 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T14:21:18.197 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-01-11T14:21:18.197 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-01-11T14:21:18.214 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-01-11T14:21:18.214 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-01-11T14:21:18.276 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-01-11T14:21:18.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-01-11T14:21:18.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-01-11T14:21:18.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-01-11T14:21:18.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-01-11T14:21:18.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-01-11T14:21:18.622 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:21:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:21:18.683 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:21:18.684 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-01-11T14:21:18.685 DEBUG:teuthology.parallel:result is None 2024-01-11T14:21:26.948 INFO:teuthology.provision.fog.smithi167:Node is ready 2024-01-11T14:21:26.948 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2024-01-11T14:21:27.008 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167 2024-01-11T14:21:27.009 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts 2024-01-11T14:21:27.067 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2024-01-11T14:21:27.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-01-11T14:21:27.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts 2024-01-11T14:21:27.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2024-01-11T14:21:27.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname 2024-01-11T14:21:27.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-01-11T14:21:27.416 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-01-11T14:21:27.473 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:21:27.473 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:21:27.474 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:21:27.475 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2024-01-11T14:21:27.475 DEBUG:teuthology.parallel:result is None 2024-01-11T14:21:53.899 WARNING:teuthology.provision.fog.smithi113:timed out 2024-01-11T14:21:59.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:22:00.143 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T14:22:00.143 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T14:22:00.428 INFO:teuthology.provision.fog.smithi113:Node is ready 2024-01-11T14:22:00.428 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2024-01-11T14:22:00.488 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113 2024-01-11T14:22:00.488 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113 /etc/hosts 2024-01-11T14:22:00.549 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2024-01-11T14:22:00.550 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-01-11T14:22:00.675 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113/smithi113/g' /etc/hosts 2024-01-11T14:22:00.703 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2024-01-11T14:22:00.773 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113/smithi113/g' /etc/hostname 2024-01-11T14:22:00.844 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-01-11T14:22:00.914 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-01-11T14:22:00.974 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:22:00.974 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:22:00.974 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2024-01-11T14:22:00.974 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2024-01-11T14:22:00.974 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:22:00.975 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:22:00.976 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2024-01-11T14:22:00.976 DEBUG:teuthology.parallel:result is None 2024-01-11T14:22:01.162 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2024-01-11T14:22:01.163 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T14:22:01.185 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-01-11T14:22:01.185 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T14:22:01.200 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2024-01-11T14:22:01.201 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T14:22:01.219 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2024-01-11T14:22:01.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-01-11T14:22:01.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:22:01.290 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-01-11T14:22:01.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-01-11T14:22:01.313 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-01-11T14:22:01.372 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-01-11T14:22:01.373 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6" 2024-01-11T14:22:01.432 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:22:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:22:01.434 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-01-11T14:22:01.460 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-01-11T14:22:01.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-01-11T14:22:01.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:22:01.533 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-01-11T14:22:01.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-01-11T14:22:01.669 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-01-11T14:22:01.727 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-01-11T14:22:01.727 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:22:01.785 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:22:01.786 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-01-11T14:22:01.786 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:22:01.786 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:22:01.786 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:22:01.786 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:22:01.786 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-01-11T14:22:01.809 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2024-01-11T14:22:01.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-01-11T14:22:01.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T14:22:01.884 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-01-11T14:22:01.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-01-11T14:22:01.976 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-01-11T14:22:02.034 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-01-11T14:22:02.034 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-01-11T14:22:02.091 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T14:22:02.092 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-01-11T14:22:02.093 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T14:22:02.093 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T14:22:02.093 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T14:22:02.093 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T14:22:02.093 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-01-11T14:22:02.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:22:02.214 INFO:teuthology.dispatcher.supervisor:Running job 7511371 2024-01-11T14:22:02.215 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371 --name vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371/orig.config.yaml 2024-01-11T14:22:02.219 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371 2024-01-11T14:22:02.219 INFO:teuthology.dispatcher.supervisor:Job PID: 2506626 2024-01-11T14:22:02.219 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-11T14:24:02.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:26:02.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:28:02.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:30:02.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:32:02.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:34:03.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:36:03.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:38:03.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:40:03.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:42:03.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:44:04.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:46:04.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:48:04.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:50:04.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:52:04.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:54:04.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:56:05.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T14:58:05.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:00:05.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:02:05.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:04:05.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:06:05.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:08:06.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:10:06.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:12:06.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:14:06.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:16:06.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:18:06.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:20:07.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:22:07.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:24:07.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:26:07.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:28:07.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:30:07.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:32:08.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:34:08.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:36:08.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:38:08.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:40:08.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:42:09.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:44:09.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:46:09.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:48:09.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:50:09.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:52:09.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:54:10.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:56:10.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T15:58:10.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:00:10.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:02:10.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:04:10.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:06:11.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:08:11.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:10:11.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T16:10:11.489 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-11T16:10:11.699 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-11T16:10:11.700 INFO:teuthology.nuke:Checking targets against current locks 2024-01-11T16:10:11.748 DEBUG:teuthology.nuke:shortname: smithi113 2024-01-11T16:10:11.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T16:10:11.768 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 14:16:15.117589', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHX4dAjulPUBWGqd1/9gyppTURk2cQ9YZWoJOwYXHcGPUiKAhIL0VKv0YG4mTAo8bpatbxjpoFvNIqnUVXvM0jY='} 2024-01-11T16:10:11.773 DEBUG:teuthology.nuke:shortname: smithi142 2024-01-11T16:10:11.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T16:10:11.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 14:16:15.121431', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBbWbLCadHrAvCNRAdV6cmMXo1LDVGsdVjkrTMz48Mz7e/lShk1xktxu0RtInDN/zzFe+Lkypjd3MXuEYuG07s='} 2024-01-11T16:10:11.799 DEBUG:teuthology.nuke:shortname: smithi167 2024-01-11T16:10:11.799 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T16:10:11.816 INFO:teuthology.orchestra.console.smithi113:Power off 2024-01-11T16:10:11.817 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T16:10:11.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 14:16:15.119589', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAWT+Ni2H7PbGL1s4qJU263KqZpe6x3tszjNrF8ODegLHeybPcVUl1+Q2Up+UNsU/KkHOEchO+MVfM8RWs2qb4='} 2024-01-11T16:10:11.840 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-01-11T16:10:11.840 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T16:10:11.857 INFO:teuthology.orchestra.console.smithi142:Power off 2024-01-11T16:10:11.857 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T16:10:11.870 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-01-11T16:10:11.880 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-01-11T16:10:11.880 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T16:10:11.897 INFO:teuthology.orchestra.console.smithi167:Power off 2024-01-11T16:10:11.897 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T16:10:11.905 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-11T16:10:11.917 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-01-11T16:10:11.917 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T16:10:11.938 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-11T16:10:11.971 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-01-11T16:10:12.006 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-01-11T16:10:12.039 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-01-11T16:10:12.122 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com 2024-01-11T16:10:12.146 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2024-01-11T16:10:12.188 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com