2023-12-19T05:10:55.699 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T05:10:55.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:10:55.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f1b9d1940>, signals=[15]) 2023-12-19T05:10:55.870 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-12-19T05:10:55.870 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:55.870 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-19T05:10:55.887 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-12-19T05:10:55.887 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:55.887 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-12-19T05:10:55.911 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-12-19T05:10:55.911 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T05:10:55.911 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-19T05:10:55.993 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:56.025 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:56.031 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T05:10:56.034 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2023-12-19T05:10:56.071 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2023-12-19T05:10:56.081 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2023-12-19T05:10:56.731 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-19T05:10:56.731 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:56.752 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:56.752 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.774 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-19T05:10:56.801 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-19T05:10:56.802 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:56.814 INFO:teuthology.orchestra.console.smithi148:Power off 2023-12-19T05:10:56.815 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:10:56.822 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:56.822 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.836 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-12-19T05:10:56.837 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:10:56.850 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T05:10:56.863 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-19T05:11:00.779 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:00.851 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:00.865 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:00.888 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-19T05:11:00.961 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T05:11:00.972 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-19T05:11:04.894 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:04.962 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:04.973 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.003 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-19T05:11:05.069 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T05:11:05.081 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-19T05:11:05.104 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-19T05:11:05.169 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-19T05:11:05.205 INFO:teuthology.orchestra.console.smithi078:Power on 2023-12-19T05:11:05.205 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:05.226 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:05.226 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.250 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-19T05:11:05.270 INFO:teuthology.orchestra.console.smithi157:Power on 2023-12-19T05:11:05.270 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:05.289 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:05.289 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:05.308 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T05:11:09.086 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:09.194 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-19T05:11:09.251 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:09.295 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-12-19T05:11:09.309 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:09.360 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-19T05:11:09.396 INFO:teuthology.orchestra.console.smithi148:Power on 2023-12-19T05:11:09.396 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T05:11:09.416 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-12-19T05:11:09.416 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:09.422 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T05:11:09.436 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-19T05:11:13.365 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:13.424 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:13.437 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:13.475 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-19T05:11:13.531 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-19T05:11:13.545 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-19T05:11:13.575 INFO:teuthology.orchestra.console.smithi078:Power on completed 2023-12-19T05:11:13.633 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-12-19T05:11:13.676 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-12-19T05:11:13.734 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-12-19T05:11:17.550 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:11:17.658 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-19T05:11:17.759 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-12-19T05:11:17.859 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-12-19T05:16:14.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:17.938 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:16:23.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:26.993 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:16:32.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:36.049 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:16:42.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:45.109 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:16:51.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:16:54.194 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:17:00.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:03.249 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:17:09.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:12.309 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-19T05:17:15.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:18.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:18.321 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:17:24.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:27.377 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:17:30.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:33.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:33.937 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:17:36.433 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:17:39.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:42.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:42.993 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:17:45.490 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:17:48.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:51.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:17:52.049 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:17:54.545 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:17:58.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:00.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:01.105 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:18:03.601 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:18:07.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:09.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:10.161 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:18:12.657 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:18:16.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:18.318 WARNING:teuthology.provision.fog.smithi148:timed out 2023-12-19T05:18:18.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:19.217 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-19T05:18:21.713 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-19T05:18:24.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:24.549 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:18:24.550 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:18:24.822 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-12-19T05:18:24.822 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-12-19T05:18:24.839 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 2023-12-19T05:18:24.840 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148 /etc/hosts 2023-12-19T05:18:24.898 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-12-19T05:18:24.898 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-12-19T05:18:24.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hosts 2023-12-19T05:18:25.026 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-12-19T05:18:25.094 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148/smithi148/g' /etc/hostname 2023-12-19T05:18:25.161 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-12-19T05:18:25.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:18:25.228 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-12-19T05:18:25.285 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:18:25.285 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:18:25.285 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-12-19T05:18:25.285 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:18:25.286 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:18:25.287 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-12-19T05:18:25.289 DEBUG:teuthology.parallel:result is None 2023-12-19T05:18:27.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:25.278 WARNING:teuthology.provision.fog.smithi078:timed out 2023-12-19T05:19:27.721 WARNING:teuthology.provision.fog.smithi157:timed out 2023-12-19T05:19:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:31.537 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:19:31.537 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:19:31.813 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-12-19T05:19:31.813 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-12-19T05:19:31.874 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2023-12-19T05:19:31.874 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2023-12-19T05:19:31.935 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-12-19T05:19:31.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-12-19T05:19:32.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2023-12-19T05:19:32.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-12-19T05:19:32.155 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2023-12-19T05:19:32.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-12-19T05:19:32.304 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-19T05:19:32.363 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:19:32.364 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:19:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:19:32.365 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-12-19T05:19:32.366 DEBUG:teuthology.parallel:result is None 2023-12-19T05:19:33.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:33.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T05:19:33.933 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T05:19:34.164 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-12-19T05:19:34.164 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-12-19T05:19:34.223 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157 2023-12-19T05:19:34.223 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157 /etc/hosts 2023-12-19T05:19:34.282 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-12-19T05:19:34.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-19T05:19:34.397 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157/smithi157/g' /etc/hosts 2023-12-19T05:19:34.425 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-12-19T05:19:34.494 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157/smithi157/g' /etc/hostname 2023-12-19T05:19:34.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-19T05:19:34.628 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-19T05:19:34.685 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:19:34.685 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:19:34.685 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:19:34.686 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:19:34.687 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-12-19T05:19:34.687 DEBUG:teuthology.parallel:result is None 2023-12-19T05:19:34.872 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-12-19T05:19:34.872 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:19:35.079 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-12-19T05:19:35.079 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:19:35.107 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-12-19T05:19:35.107 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T05:19:35.125 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:19:35.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-19T05:19:35.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:35.195 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-12-19T05:19:35.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-19T05:19:35.266 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-12-19T05:19:35.327 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-12-19T05:19:35.327 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-12-19T05:19:35.388 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:19:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:19:35.390 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-19T05:19:35.416 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:19:35.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-19T05:19:35.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:35.484 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-12-19T05:19:35.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-19T05:19:35.623 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-12-19T05:19:35.681 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-12-19T05:19:35.681 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-12-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:19:35.740 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:19:35.740 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-12-19T05:19:35.774 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-12-19T05:19:35.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-19T05:19:35.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:19:35.842 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-19T05:19:35.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-19T05:19:35.913 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-19T05:19:35.972 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-19T05:19:35.973 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-19T05:19:36.031 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T05:19:36.032 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T05:19:36.032 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-19T05:19:36.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:19:36.152 INFO:teuthology.dispatcher.supervisor:Running job 7495701 2023-12-19T05:19:36.152 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701 --name rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701/orig.config.yaml 2023-12-19T05:19:36.155 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701 2023-12-19T05:19:36.156 INFO:teuthology.dispatcher.supervisor:Job PID: 2032426 2023-12-19T05:19:36.156 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T05:21:36.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:23:36.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:25:36.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:27:36.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:29:36.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:31:37.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:33:37.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:35:37.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:37:37.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:39:37.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:39:37.908 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T05:39:38.055 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T05:39:38.055 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T05:39:38.101 DEBUG:teuthology.nuke:shortname: smithi078 2023-12-19T05:39:38.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:39:38.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:54.843040', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNvm5XPjuH94WYLsHKQ9bpVZEwE+cmNK1oXO6iovV6nV25B1BmgLf3hJ91ruzH03/4V93hMIggAT9p1Rzj3/uIk='} 2023-12-19T05:39:38.131 DEBUG:teuthology.nuke:shortname: smithi148 2023-12-19T05:39:38.131 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:39:38.155 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-19T05:39:38.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:39:38.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:54.844644', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGuT8ZtHdehvM7x7gbLKqAGI9pPTvWvzHskv9g0bhsFDckCXSDMB7ZxTLoX3OkLYn3iyWlNiHp3okesWTJDADKA='} 2023-12-19T05:39:38.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:54.846193', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7Jw/xDSGhmKlRUrsrecpcxfLWTYx6p0Ld8vGva3KRZgVJ5mwPgvNR0vFaXRCwu/R54t9QaYTVy3G6f3aY5GkQ='} 2023-12-19T05:39:38.193 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-19T05:39:38.193 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:39:38.217 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-19T05:39:38.218 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:39:38.234 INFO:teuthology.orchestra.console.smithi148:Power off 2023-12-19T05:39:38.234 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:39:38.246 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-19T05:39:38.254 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-12-19T05:39:38.255 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:39:38.273 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-19T05:39:38.274 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T05:39:38.282 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-19T05:39:38.294 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-19T05:39:38.295 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T05:39:38.318 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-19T05:39:38.347 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-19T05:39:38.383 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-12-19T05:39:38.419 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-19T05:39:38.508 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-12-19T05:39:38.532 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-12-19T05:39:38.564 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com