2023-07-22T03:25:18.874 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-22T03:25:18.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T03:25:18.876 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T03:25:19.029 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f74b2385ee0>, signals=[15]) 2023-07-22T03:25:19.031 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-07-22T03:25:19.031 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T03:25:19.031 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-07-22T03:25:19.051 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-07-22T03:25:19.052 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T03:25:19.052 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-07-22T03:25:19.053 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-07-22T03:25:19.076 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-07-22T03:25:19.127 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-22T03:25:19.140 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-22T03:25:19.176 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_9.stream (ID 10) 2023-07-22T03:25:19.176 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 10} 2023-07-22T03:25:19.180 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10) 2023-07-22T03:25:19.181 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 10} 2023-07-22T03:25:19.214 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 9.stream 2023-07-22T03:25:19.214 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:25:19.228 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream 2023-07-22T03:25:19.228 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:25:19.269 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T03:25:19.272 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T03:25:19.313 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-07-22T03:25:19.320 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-07-22T03:25:19.366 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:25:19.369 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:25:19.459 INFO:teuthology.orchestra.console:Power off smithi116 2023-07-22T03:25:19.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T03:25:19.475 INFO:teuthology.orchestra.console:Power off smithi153 2023-07-22T03:25:19.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T03:25:19.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:19.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:23.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:23.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:27.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:27.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:27.843 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-07-22T03:25:27.944 INFO:teuthology.orchestra.console:Power on smithi153 2023-07-22T03:25:27.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T03:25:27.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:31.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:31.948 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-07-22T03:25:31.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:32.050 INFO:teuthology.orchestra.console:Power on smithi116 2023-07-22T03:25:32.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T03:25:32.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:36.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:36.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:25:36.302 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2023-07-22T03:25:36.310 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2023-07-22T03:25:36.403 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-07-22T03:25:36.404 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:25:36.411 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-07-22T03:25:36.411 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:25:51.476 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:25:51.477 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:26:06.548 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:26:06.549 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:26:21.636 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:26:21.637 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:26:36.716 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:26:36.717 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:26:51.808 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:26:51.810 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:27:06.904 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:27:06.905 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:27:21.996 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:27:21.999 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:27:37.084 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:27:37.085 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:27:52.188 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:27:52.189 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:28:07.277 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:28:07.278 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-22T03:28:07.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:10.416 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:16.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:19.472 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:22.364 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-07-22T03:28:22.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:25.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:25.488 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:28:28.528 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:31.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:34.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:34.544 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:28:37.588 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:40.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:43.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:43.600 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:28:46.676 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:49.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:52.656 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:28:52.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:28:55.728 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:28:58.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:01.712 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:29:01.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:04.784 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-22T03:29:07.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:10.772 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:29:10.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:16.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:19.856 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:29:25.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:29:28.912 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-07-22T03:29:34.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:30:10.821 WARNING:teuthology.provision.fog.smithi116:timed out 2023-07-22T03:30:16.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:30:17.103 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T03:30:17.104 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T03:30:17.430 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-07-22T03:30:17.431 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-07-22T03:30:17.445 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-07-22T03:30:17.446 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-07-22T03:30:17.500 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-07-22T03:30:17.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-07-22T03:30:17.622 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-07-22T03:30:17.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-07-22T03:30:17.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-07-22T03:30:17.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-07-22T03:30:17.850 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-07-22T03:30:17.904 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-07-22T03:30:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T03:30:17.906 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T03:30:17.907 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-07-22T03:30:17.908 DEBUG:teuthology.parallel:result is None 2023-07-22T03:30:34.936 WARNING:teuthology.provision.fog.smithi153:timed out 2023-07-22T03:30:40.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:30:41.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T03:30:41.173 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T03:30:41.552 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-07-22T03:30:41.552 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-07-22T03:30:41.567 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-07-22T03:30:41.567 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-07-22T03:30:41.622 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-07-22T03:30:41.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-07-22T03:30:41.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-07-22T03:30:41.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-07-22T03:30:41.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-07-22T03:30:41.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-07-22T03:30:41.965 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-07-22T03:30:42.020 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-07-22T03:30:42.020 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-07-22T03:30:42.021 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2023-07-22T03:30:42.022 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T03:30:42.022 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-07-22T03:30:42.022 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T03:30:42.022 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T03:30:42.022 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T03:30:42.022 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-07-22T03:30:42.023 DEBUG:teuthology.parallel:result is None 2023-07-22T03:30:42.179 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-07-22T03:30:42.180 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T03:30:42.213 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-07-22T03:30:42.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T03:30:42.232 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-07-22T03:30:42.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-22T03:30:42.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:30:42.319 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-22T03:30:42.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-22T03:30:42.487 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-07-22T03:30:42.541 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-07-22T03:30:42.541 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-07-22T03:30:42.595 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-07-22T03:30:42.595 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-07-22T03:30:42.595 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-07-22T03:30:42.595 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T03:30:42.596 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-07-22T03:30:42.597 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T03:30:42.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T03:30:42.597 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T03:30:42.597 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-07-22T03:30:42.621 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-07-22T03:30:42.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-22T03:30:42.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T03:30:42.704 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-07-22T03:30:42.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-07-22T03:30:42.771 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-07-22T03:30:42.827 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-07-22T03:30:42.828 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-07-22T03:30:42.883 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-07-22T03:30:42.883 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2023-07-22T03:30:42.883 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-07-22T03:30:42.883 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-22T03:30:42.884 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-07-22T03:30:42.885 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T03:30:42.885 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-22T03:30:42.885 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T03:30:42.885 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-07-22T03:30:42.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T03:30:42.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T03:30:43.023 INFO:teuthology.dispatcher.supervisor:Running job 7347096 2023-07-22T03:30:43.024 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347096 --name yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347096/orig.config.yaml 2023-07-22T03:30:43.027 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347096 2023-07-22T03:30:43.028 INFO:teuthology.dispatcher.supervisor:Job PID: 31112 2023-07-22T03:30:43.028 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-22T03:32:43.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T03:32:43.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T03:32:43.189 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-22T03:32:43.306 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-22T03:32:43.306 INFO:teuthology.nuke:Checking targets against current locks 2023-07-22T03:32:43.362 DEBUG:teuthology.nuke:shortname: smithi116 2023-07-22T03:32:43.362 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T03:32:43.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 03:25:18.095466', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIh+gsASFr2Eyj1fcOygxDFDmGy9JbmZ5rlvpE/u+G5WyDc+meT/mYcbTlnle6gf94m5LXuG95is76DdMDeDA8M='} 2023-07-22T03:32:43.388 DEBUG:teuthology.nuke:shortname: smithi153 2023-07-22T03:32:43.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T03:32:43.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:31-fs-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 03:25:18.092313', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFEGgm53WKj7Z2vwzU42lzPZMbq/ZLlbhLG3V4vaJ4Zg7GFP1dKNgN6QWPxrOg9sV4e1AaTlXFjtMYeTuzI0O20='} 2023-07-22T03:32:43.443 INFO:teuthology.orchestra.console:Power off smithi116 2023-07-22T03:32:43.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T03:32:43.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:32:43.484 INFO:teuthology.orchestra.console:Power off smithi153 2023-07-22T03:32:43.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T03:32:43.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T03:32:43.593 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-07-22T03:32:43.625 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-07-22T03:32:43.755 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-07-22T03:32:43.771 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com