2023-12-11T19:20:31.170 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T19:20:31.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:20:31.336 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9d63c6940>, signals=[15]) 2023-12-11T19:20:31.336 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-12-11T19:20:31.337 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T19:20:31.337 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-11T19:20:31.361 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-12-11T19:20:31.361 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T19:20:31.361 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-11T19:20:31.412 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2023-12-11T19:20:31.412 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T19:20:31.413 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-12-11T19:20:31.483 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T19:20:31.529 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6 2023-12-11T19:20:31.534 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T19:20:31.578 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2023-12-11T19:20:31.582 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T19:20:31.636 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.6 2023-12-11T19:20:31.814 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-11T19:20:31.814 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T19:20:31.825 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-11T19:20:31.826 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T19:20:31.837 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-11T19:20:31.837 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:31.847 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-11T19:20:31.847 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:31.858 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-11T19:20:31.871 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T19:20:31.955 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-11T19:20:31.955 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T19:20:31.975 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-11T19:20:31.975 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:31.999 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-11T19:20:32.100 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-11T19:20:32.200 INFO:teuthology.orchestra.console.smithi196:Power on 2023-12-11T19:20:32.201 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T19:20:32.222 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2023-12-11T19:20:32.222 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:32.245 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-11T19:20:35.862 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:35.872 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:35.971 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-11T19:20:35.981 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T19:20:36.246 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:36.354 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-12-11T19:20:36.455 INFO:teuthology.orchestra.console.smithi196:Power on completed 2023-12-11T19:20:36.556 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2023-12-11T19:20:39.974 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:39.982 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:40.083 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-11T19:20:40.090 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T19:20:40.185 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-11T19:20:40.285 INFO:teuthology.orchestra.console.smithi099:Power on 2023-12-11T19:20:40.286 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T19:20:40.307 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-12-11T19:20:40.307 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:40.329 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-11T19:20:44.094 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:44.203 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T19:20:44.304 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-11T19:20:44.330 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:44.405 INFO:teuthology.orchestra.console.smithi138:Power on 2023-12-11T19:20:44.406 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T19:20:44.427 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2023-12-11T19:20:44.428 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:44.440 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-11T19:20:44.449 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T19:20:48.444 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:48.452 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:48.554 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-11T19:20:48.561 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T19:20:48.655 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-12-11T19:20:48.755 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-12-11T19:20:52.562 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T19:20:52.670 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T19:20:52.771 INFO:teuthology.orchestra.console.smithi138:Power on completed 2023-12-11T19:20:52.872 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-12-11T19:23:22.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:25.442 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:23:31.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:34.530 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:23:34.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:37.702 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-11T19:23:38.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:40.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:41.766 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:23:43.586 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:23:43.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:46.786 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-11T19:23:47.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:49.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:50.854 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:23:52.642 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:23:52.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:55.842 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-11T19:23:56.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:58.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:23:59.906 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:24:01.698 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:24:01.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:04.898 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-11T19:24:05.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:07.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:08.962 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:24:10.758 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:24:10.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:13.954 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-11T19:24:14.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:16.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:18.018 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:24:19.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:24.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:27.078 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T19:24:33.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:35.302 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:24:41.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:44.390 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-12-11T19:24:50.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:24:52.283 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T19:24:52.284 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T19:24:52.681 INFO:teuthology.provision.fog.smithi196:Node is ready 2023-12-11T19:24:52.681 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2023-12-11T19:24:52.737 INFO:teuthology.orchestra.run.smithi196.stdout:smithi022 2023-12-11T19:24:52.746 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi022 /etc/hosts 2023-12-11T19:24:52.795 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-11T19:24:52.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-11T19:24:52.984 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi022/smithi196/g' /etc/hosts 2023-12-11T19:24:53.011 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.22/172.21.15.196/g' /etc/hosts 2023-12-11T19:24:53.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi022/smithi196/g' /etc/hostname 2023-12-11T19:24:53.164 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-12-11T19:24:53.233 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-12-11T19:24:53.289 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:24:53.290 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:24:53.291 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2023-12-11T19:24:53.292 DEBUG:teuthology.parallel:result is None 2023-12-11T19:25:19.987 WARNING:teuthology.provision.fog.smithi099:timed out 2023-12-11T19:25:25.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:25:26.335 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T19:25:26.335 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T19:25:26.622 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-12-11T19:25:26.622 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-12-11T19:25:26.641 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-12-11T19:25:26.641 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-12-11T19:25:26.701 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-12-11T19:25:26.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-11T19:25:26.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-12-11T19:25:26.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-12-11T19:25:26.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-12-11T19:25:26.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-11T19:25:27.055 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-11T19:25:27.112 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:25:27.112 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:25:27.112 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:25:27.113 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:25:27.114 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:25:27.114 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:25:27.114 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-12-11T19:25:27.115 DEBUG:teuthology.parallel:result is None 2023-12-11T19:25:33.090 WARNING:teuthology.provision.fog.smithi138:timed out 2023-12-11T19:25:39.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:25:39.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T19:25:39.423 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T19:25:39.742 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-12-11T19:25:39.742 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-12-11T19:25:39.760 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-12-11T19:25:39.760 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-12-11T19:25:39.817 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-12-11T19:25:39.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-11T19:25:39.945 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-12-11T19:25:39.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-12-11T19:25:40.041 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-12-11T19:25:40.107 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-11T19:25:40.171 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-11T19:25:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:25:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:25:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-11T19:25:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:25:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:25:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:25:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:25:40.231 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-12-11T19:25:40.232 DEBUG:teuthology.parallel:result is None 2023-12-11T19:25:40.425 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-12-11T19:25:40.425 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T19:25:40.452 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-12-11T19:25:40.452 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T19:25:40.468 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2023-12-11T19:25:40.468 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T19:25:40.486 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-12-11T19:25:40.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-11T19:25:40.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:25:40.554 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-11T19:25:40.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-11T19:25:40.688 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-12-11T19:25:40.746 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-12-11T19:25:40.746 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-11T19:25:40.804 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:25:40.804 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:25:40.804 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-11T19:25:40.804 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-11T19:25:40.805 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:25:40.806 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:25:40.806 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:25:40.806 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:25:40.806 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-11T19:25:40.827 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-12-11T19:25:40.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-11T19:25:40.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:25:40.894 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-12-11T19:25:40.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-11T19:25:40.966 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-12-11T19:25:41.026 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-12-11T19:25:41.026 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-11T19:25:41.086 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:25:41.086 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:25:41.086 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-11T19:25:41.086 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:25:41.087 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:25:41.088 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-11T19:25:41.110 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2023-12-11T19:25:41.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-12-11T19:25:41.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:25:41.177 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-12-11T19:25:41.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-12-11T19:25:41.308 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-12-11T19:25:41.364 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-12-11T19:25:41.365 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-12-11T19:25:41.421 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:25:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:25:41.423 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:25:41.423 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-12-11T19:25:41.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:25:41.552 INFO:teuthology.dispatcher.supervisor:Running job 7487228 2023-12-11T19:25:41.552 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228 --name rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228/orig.config.yaml 2023-12-11T19:25:41.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228 2023-12-11T19:25:41.556 INFO:teuthology.dispatcher.supervisor:Job PID: 736314 2023-12-11T19:25:41.557 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-11T19:27:41.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:29:41.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:31:41.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:33:42.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:35:42.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:37:42.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:39:42.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:41:42.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:43:43.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:45:43.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:47:43.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:49:43.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:51:43.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:53:43.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:55:44.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:57:44.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:59:44.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:01:44.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:03:44.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:05:44.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:07:45.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:09:45.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:11:45.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:13:45.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:15:45.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:17:45.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:19:46.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:21:46.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:23:46.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:25:46.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:27:46.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:29:46.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:31:47.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:33:47.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:35:47.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:37:47.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:39:47.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:41:47.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:43:48.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:45:48.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:47:48.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:49:48.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:51:48.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:53:48.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:55:49.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:57:49.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:59:49.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:01:49.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:03:49.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:05:49.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:07:50.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:09:50.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:11:50.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:13:50.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:15:50.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:17:50.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:19:51.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:21:51.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:23:51.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:25:51.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:27:51.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:29:51.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:31:52.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:33:52.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:35:52.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:37:52.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:39:52.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:41:52.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:43:53.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:45:53.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:47:53.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:49:53.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:51:53.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T21:51:53.851 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-11T21:51:54.129 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-11T21:51:54.129 INFO:teuthology.nuke:Checking targets against current locks 2023-12-11T21:51:54.179 DEBUG:teuthology.nuke:shortname: smithi099 2023-12-11T21:51:54.179 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T21:51:54.204 DEBUG:teuthology.nuke:shortname: smithi138 2023-12-11T21:51:54.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T21:51:54.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:20:30.089930', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T21:51:54.218 DEBUG:teuthology.nuke:shortname: smithi196 2023-12-11T21:51:54.218 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T21:51:54.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:20:30.088321', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T21:51:54.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:20:30.086451', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T21:51:54.256 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-11T21:51:54.256 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T21:51:54.280 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-11T21:51:54.281 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T21:51:54.296 INFO:teuthology.orchestra.console.smithi196:Power off 2023-12-11T21:51:54.296 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T21:51:54.310 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-11T21:51:54.310 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T21:51:54.317 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-11T21:51:54.319 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-12-11T21:51:54.319 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T21:51:54.330 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-11T21:51:54.331 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T21:51:54.341 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-12-11T21:51:54.351 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T21:51:54.419 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-11T21:51:54.442 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-12-11T21:51:54.451 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-11T21:51:54.584 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-12-11T21:51:54.606 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2023-12-11T21:51:54.615 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com