2024-01-25T22:26:53.155 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-25T22:26:53.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:26:53.329 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb2db4fc10>, signals=[15]) 2024-01-25T22:26:53.330 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2024-01-25T22:26:53.330 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T22:26:53.330 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-25T22:26:53.355 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-01-25T22:26:53.355 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T22:26:53.356 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-25T22:26:53.380 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2024-01-25T22:26:53.380 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T22:26:53.380 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-01-25T22:26:53.462 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-25T22:26:53.497 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-25T22:26:53.512 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-25T22:26:53.543 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2024-01-25T22:26:53.561 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6 2024-01-25T22:26:53.571 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2024-01-25T22:26:53.875 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-25T22:26:53.876 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T22:26:53.890 INFO:teuthology.orchestra.console.smithi167:Power off 2024-01-25T22:26:53.890 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T22:26:53.902 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-25T22:26:53.902 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T22:26:53.910 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-25T22:26:53.910 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:53.919 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-01-25T22:26:53.919 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:53.928 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-25T22:26:53.929 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:53.937 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-25T22:26:53.942 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-25T22:26:53.950 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-25T22:26:54.043 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-01-25T22:26:54.051 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-25T22:26:54.144 INFO:teuthology.orchestra.console.smithi167:Power on 2024-01-25T22:26:54.145 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T22:26:54.152 INFO:teuthology.orchestra.console.smithi125:Power on 2024-01-25T22:26:54.153 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T22:26:54.166 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2024-01-25T22:26:54.166 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:54.175 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2024-01-25T22:26:54.175 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:54.193 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-25T22:26:54.197 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-25T22:26:57.941 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:58.051 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-25T22:26:58.194 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:58.201 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:26:58.303 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-25T22:26:58.309 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-25T22:27:02.054 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:02.164 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-25T22:27:02.304 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:02.310 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:02.413 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-01-25T22:27:02.418 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-25T22:27:02.514 INFO:teuthology.orchestra.console.smithi167:Power on completed 2024-01-25T22:27:02.519 INFO:teuthology.orchestra.console.smithi125:Power on completed 2024-01-25T22:27:02.615 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2024-01-25T22:27:02.620 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2024-01-25T22:27:06.167 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:06.277 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-25T22:27:06.377 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-25T22:27:06.478 INFO:teuthology.orchestra.console.smithi148:Power on 2024-01-25T22:27:06.479 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T22:27:06.503 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-01-25T22:27:06.504 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:06.526 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-25T22:27:10.530 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T22:27:10.640 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-25T22:27:10.741 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-01-25T22:27:10.841 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-01-25T22:29:48.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:29:48.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:29:51.644 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:29:51.644 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:29:57.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:29:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:00.700 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:30:00.700 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:06.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:06.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:09.760 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:30:09.792 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:11.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:14.844 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:30:15.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:15.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:18.812 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:30:18.844 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:20.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:23.900 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:30:24.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:24.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:27.868 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:30:27.900 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:29.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:32.956 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:30:33.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:33.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:36.928 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-25T22:30:36.956 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:38.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:42.016 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:30:42.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:42.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:46.016 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-01-25T22:30:48.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:51.104 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:30:52.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:30:57.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:00.192 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:31:06.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:09.276 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:31:15.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:33.696 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:31:39.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:42.784 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:31:42.933 WARNING:teuthology.provision.fog.smithi125:timed out 2024-01-25T22:31:48.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:48.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:49.187 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T22:31:49.191 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T22:31:49.503 INFO:teuthology.provision.fog.smithi125:Node is ready 2024-01-25T22:31:49.504 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2024-01-25T22:31:49.521 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2024-01-25T22:31:49.522 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2024-01-25T22:31:49.577 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2024-01-25T22:31:49.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-25T22:31:49.678 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2024-01-25T22:31:49.707 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2024-01-25T22:31:49.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2024-01-25T22:31:49.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-25T22:31:49.903 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-25T22:31:49.958 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:31:49.959 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:31:49.959 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2024-01-25T22:31:49.959 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2024-01-25T22:31:49.959 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2024-01-25T22:31:49.960 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:31:49.960 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:31:49.960 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-25T22:31:49.960 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:31:49.960 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:31:49.961 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:31:49.962 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:31:49.963 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2024-01-25T22:31:49.965 DEBUG:teuthology.parallel:result is None 2024-01-25T22:31:51.868 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-25T22:31:52.020 WARNING:teuthology.provision.fog.smithi167:timed out 2024-01-25T22:31:57.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:58.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:31:58.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T22:31:58.246 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T22:31:58.507 INFO:teuthology.provision.fog.smithi167:Node is ready 2024-01-25T22:31:58.507 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2024-01-25T22:31:58.526 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167 2024-01-25T22:31:58.526 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts 2024-01-25T22:31:58.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T22:31:58.562 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T22:31:58.583 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2024-01-25T22:31:58.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-01-25T22:31:58.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts 2024-01-25T22:31:58.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2024-01-25T22:31:58.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname 2024-01-25T22:31:58.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-01-25T22:31:58.924 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-01-25T22:31:58.979 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:31:58.980 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-01-25T22:31:58.981 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:31:58.981 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:31:58.981 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:31:58.981 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:31:58.981 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2024-01-25T22:31:58.982 DEBUG:teuthology.parallel:result is None 2024-01-25T22:32:14.531 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-01-25T22:32:14.531 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-01-25T22:32:14.553 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-01-25T22:32:14.554 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-01-25T22:32:14.614 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-01-25T22:32:14.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-25T22:32:14.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-01-25T22:32:14.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-01-25T22:32:14.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-01-25T22:32:14.912 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-25T22:32:14.979 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:32:15.036 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:32:15.037 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:32:15.037 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-01-25T22:32:15.038 DEBUG:teuthology.parallel:result is None 2024-01-25T22:32:15.229 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2024-01-25T22:32:15.229 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T22:32:15.252 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-01-25T22:32:15.252 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T22:32:15.268 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2024-01-25T22:32:15.268 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T22:32:15.286 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2024-01-25T22:32:15.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-25T22:32:15.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:32:15.361 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-01-25T22:32:15.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-25T22:32:15.497 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-01-25T22:32:15.556 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-01-25T22:32:15.556 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-25T22:32:15.613 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-25T22:32:15.614 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:32:15.615 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:32:15.615 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:32:15.615 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:32:15.615 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-25T22:32:15.636 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-01-25T22:32:15.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-25T22:32:15.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:32:15.710 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-01-25T22:32:15.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-25T22:32:15.778 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-01-25T22:32:15.834 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-01-25T22:32:15.835 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-25T22:32:15.891 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:32:15.892 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:32:15.893 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-01-25T22:32:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:32:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:32:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:32:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:32:15.894 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-25T22:32:15.919 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2024-01-25T22:32:15.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-01-25T22:32:15.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T22:32:15.992 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-01-25T22:32:16.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-01-25T22:32:16.126 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-01-25T22:32:16.184 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-01-25T22:32:16.184 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-01-25T22:32:16.242 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T22:32:16.243 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-25T22:32:16.244 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-25T22:32:16.244 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-25T22:32:16.244 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-01-25T22:32:16.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:32:16.365 INFO:teuthology.dispatcher.supervisor:Running job 7531666 2024-01-25T22:32:16.366 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666 --name yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666/orig.config.yaml 2024-01-25T22:32:16.369 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666 2024-01-25T22:32:16.369 INFO:teuthology.dispatcher.supervisor:Job PID: 2910834 2024-01-25T22:32:16.369 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-25T22:34:16.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:36:16.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:38:16.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:40:16.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:42:17.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:44:17.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:46:17.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:48:17.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:50:17.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:52:17.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:54:18.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:56:18.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T22:58:18.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T23:00:18.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T23:02:18.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T23:02:18.938 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-25T23:02:19.073 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-25T23:02:19.073 INFO:teuthology.nuke:Checking targets against current locks 2024-01-25T23:02:19.126 DEBUG:teuthology.nuke:shortname: smithi125 2024-01-25T23:02:19.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T23:02:19.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 22:26:52.084785', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFK0IZrlG6O9eQGyrYTKEQySTrUxGUjlHXS7gYNDR9hGayOAwlIIu1Kvunk5xNl9gow5QAnw38LVr1nmI+MbyAQ='} 2024-01-25T23:02:19.151 DEBUG:teuthology.nuke:shortname: smithi148 2024-01-25T23:02:19.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T23:02:19.164 DEBUG:teuthology.nuke:shortname: smithi167 2024-01-25T23:02:19.164 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T23:02:19.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 22:26:52.087948', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgDRy93F7HPa9RPI2MjCbBImOAohh0DjCjsKE+keZM4mp8k8DGfC14klcU8h4nfPGhexLxbWuwzLmHId7WEuRI='} 2024-01-25T23:02:19.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-25_16:18:39-fs-wip-vshankar-testing1-reef-2024-01-24-1150-distro-default-smithi/7531666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 22:26:52.086536', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJ5wAvo3YHhmuC7wrd3InablkSDu9wrLSiB8SiT7uMNVu69HSF/vLJ32rVGUSIlh1qzILk23dhBBWQdrwRI8V0='} 2024-01-25T23:02:19.198 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-25T23:02:19.198 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T23:02:19.220 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-25T23:02:19.220 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T23:02:19.236 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-25T23:02:19.236 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T23:02:19.249 INFO:teuthology.orchestra.console.smithi167:Power off 2024-01-25T23:02:19.250 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T23:02:19.260 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-25T23:02:19.262 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-25T23:02:19.262 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T23:02:19.278 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-01-25T23:02:19.278 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T23:02:19.288 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-25T23:02:19.301 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-01-25T23:02:19.362 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-25T23:02:19.389 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-25T23:02:19.402 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-01-25T23:02:19.511 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2024-01-25T23:02:19.537 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2024-01-25T23:02:19.545 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com