2023-12-19T13:40:08.856 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:40:08.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:40:08.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7dfb8b8940>, signals=[15]) 2023-12-19T13:40:08.992 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-12-19T13:40:08.992 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:08.992 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.014 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.014 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.014 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.135 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:09.147 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:09.188 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of rhel 8.6 2023-12-19T13:40:09.195 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6 2023-12-19T13:40:09.476 INFO:teuthology.orchestra.console.smithi170:Power off 2023-12-19T13:40:09.476 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:09.491 INFO:teuthology.orchestra.console.smithi052:Power off 2023-12-19T13:40:09.491 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:09.499 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:09.499 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:09.513 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:09.513 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:09.524 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:40:09.536 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-19T13:40:09.625 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-12-19T13:40:09.637 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-12-19T13:40:09.726 INFO:teuthology.orchestra.console.smithi170:Power on 2023-12-19T13:40:09.727 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:09.738 INFO:teuthology.orchestra.console.smithi052:Power on 2023-12-19T13:40:09.738 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:09.750 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:09.750 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:09.765 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:09.765 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:09.777 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:40:09.787 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-19T13:40:13.781 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:13.789 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:13.892 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:40:13.898 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-19T13:40:17.896 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:17.908 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.009 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-19T13:40:18.020 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-19T13:40:18.111 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-12-19T13:40:18.121 INFO:teuthology.orchestra.console.smithi052:Power on completed 2023-12-19T13:40:18.212 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-12-19T13:40:18.223 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-12-19T13:40:18.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:40:21.362 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:40:27.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:40:30.422 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:40:36.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:40:39.510 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:40:45.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:40:48.593 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:40:54.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:40:57.649 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:41:03.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:41:06.709 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:41:12.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:41:15.793 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:41:21.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:41:40.246 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:41:46.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:41:46.560 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:41:52.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:41:52.692 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:41:56.817 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:42:03.904 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:42:13.991 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:42:27.118 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:42:43.243 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-19T13:42:49.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:42:52.274 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:42:58.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:01.329 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:43:07.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:10.385 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:43:16.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:19.441 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:43:20.593 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:25.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:26.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:28.501 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:43:29.649 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:34.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:35.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:37.553 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-19T13:43:38.705 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:43.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:44.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:44.849 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:43:50.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:01.046 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:07.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:10.129 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:16.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:19.189 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-19T13:44:25.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:25.445 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:44:25.446 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:44:43.557 WARNING:teuthology.provision.fog.smithi052:timed out 2023-12-19T13:44:45.686 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-12-19T13:44:45.686 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-12-19T13:44:45.708 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-12-19T13:44:45.709 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-12-19T13:44:45.769 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-12-19T13:44:45.769 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-12-19T13:44:45.926 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-12-19T13:44:45.957 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-12-19T13:44:46.028 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-12-19T13:44:46.098 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-12-19T13:44:46.166 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-12-19T13:44:46.224 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:46.224 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:46.224 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:46.225 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:46.226 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:46.227 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-12-19T13:44:46.228 DEBUG:teuthology.parallel:result is None 2023-12-19T13:44:49.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:49.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:44:49.769 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:44:50.059 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-12-19T13:44:50.136 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-12-19T13:44:50.158 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-12-19T13:44:50.158 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-12-19T13:44:50.219 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-12-19T13:44:50.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-12-19T13:44:50.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-12-19T13:44:50.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-12-19T13:44:50.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-12-19T13:44:50.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-12-19T13:44:50.636 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6" 2023-12-19T13:44:50.697 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:50.698 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:50.698 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-12-19T13:44:50.699 DEBUG:teuthology.parallel:result is None 2023-12-19T13:44:50.869 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-12-19T13:44:50.869 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:44:50.889 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-12-19T13:44:50.890 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:44:50.907 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:44:50.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-19T13:44:50.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:50.975 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-12-19T13:44:51.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-19T13:44:51.051 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-12-19T13:44:51.111 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-12-19T13:44:51.112 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-12-19T13:44:51.172 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:51.172 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:51.172 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:51.174 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-12-19T13:44:51.198 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:44:51.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-19T13:44:51.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:51.267 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-12-19T13:44:51.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-19T13:44:51.338 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-12-19T13:44:51.396 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-12-19T13:44:51.396 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:51.456 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:51.457 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-19T13:44:51.457 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:51.457 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:51.457 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:51.457 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:51.457 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-12-19T13:44:51.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:44:51.581 INFO:teuthology.dispatcher.supervisor:Running job 7496802 2023-12-19T13:44:51.581 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496802 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496802/orig.config.yaml 2023-12-19T13:44:51.584 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496802 2023-12-19T13:44:51.585 INFO:teuthology.dispatcher.supervisor:Job PID: 1354340 2023-12-19T13:44:51.585 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:46:51.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:48:51.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:50:51.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:52:51.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:54:51.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:56:51.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:58:52.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:58:52.096 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T13:58:52.200 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803 2023-12-19T13:58:52.200 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T13:58:52.200 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T13:58:52.254 DEBUG:teuthology.nuke:shortname: smithi052 2023-12-19T13:58:52.254 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:58:52.275 DEBUG:teuthology.nuke:shortname: smithi170 2023-12-19T13:58:52.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:58:52.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.037848', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyPOoZuhfWWLdEGoJ7Rq7iqhIET7iDxaJPHTMOdzjrur32TlUsf+l+21RzFrqM2oGlD9Xgn3d37Zflezi7awRg='} 2023-12-19T13:58:52.296 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.410264', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgDep2/mPvIy4YUPdD63x39XTidC1cKAOTCXbVREvZRIa++mHzI6D3Mkolhi4l3Kf1zFenNwKFCqgAuyPPbDnA='} 2023-12-19T13:58:52.326 INFO:teuthology.orchestra.console.smithi052:Power off 2023-12-19T13:58:52.327 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:58:52.341 INFO:teuthology.orchestra.console.smithi170:Power off 2023-12-19T13:58:52.342 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:58:52.350 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-12-19T13:58:52.350 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:58:52.363 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-12-19T13:58:52.364 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:58:52.376 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-19T13:58:52.387 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-19T13:58:52.478 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-12-19T13:58:52.488 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-12-19T13:58:52.636 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2023-12-19T13:58:52.644 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com