2023-07-12T11:56:13.518 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T11:56:13.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T11:56:13.521 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T11:56:13.719 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd56ace78b0>, signals=[15]) 2023-07-12T11:56:13.721 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-07-12T11:56:13.722 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T11:56:13.722 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-12T11:56:13.751 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-07-12T11:56:13.751 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T11:56:13.752 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-12T11:56:13.754 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-07-12T11:56:13.775 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-07-12T11:56:13.839 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T11:56:13.846 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T11:56:13.885 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T11:56:13.885 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 5} 2023-07-12T11:56:13.888 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T11:56:13.889 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 5} 2023-07-12T11:56:13.926 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.6 2023-07-12T11:56:13.926 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:56:13.929 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.6 2023-07-12T11:56:13.929 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:56:13.987 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T11:56:13.997 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T11:56:14.022 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-07-12T11:56:14.036 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-07-12T11:56:14.070 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:56:14.086 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:56:14.176 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-12T11:56:14.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T11:56:14.199 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-12T11:56:14.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T11:56:14.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:14.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:18.245 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:18.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:22.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:22.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:22.579 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-12T11:56:22.680 INFO:teuthology.orchestra.console:Power on smithi055 2023-07-12T11:56:22.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T11:56:22.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:26.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:26.703 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-12T11:56:26.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:26.805 INFO:teuthology.orchestra.console:Power on smithi061 2023-07-12T11:56:26.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T11:56:26.830 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:30.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:30.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T11:56:31.074 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2023-07-12T11:56:31.104 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2023-07-12T11:56:31.176 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-07-12T11:56:31.177 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:56:31.205 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-07-12T11:56:31.206 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:56:46.260 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:56:46.267 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:57:01.349 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:57:01.351 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:57:16.429 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:57:16.432 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:57:31.516 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:57:31.517 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:57:46.592 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:57:46.593 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:58:01.680 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:58:01.681 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:58:16.768 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:58:16.770 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:58:31.852 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:58:31.854 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:58:46.948 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:58:46.949 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:59:02.034 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:59:02.036 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-12T11:59:02.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:05.172 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-12T11:59:11.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:14.256 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-12T11:59:17.112 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-12T11:59:17.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:20.240 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T11:59:20.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:23.312 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-12T11:59:26.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:29.296 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T11:59:29.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:32.368 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-12T11:59:35.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:38.356 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T11:59:38.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:41.424 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-12T11:59:44.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:47.408 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T11:59:47.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:53.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T11:59:56.464 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T12:00:02.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:00:05.520 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T12:00:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:00:14.576 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-12T12:00:19.142 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:00:19.143 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:00:19.429 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-07-12T12:00:19.430 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-07-12T12:00:19.491 INFO:teuthology.orchestra.run.smithi055.stdout:smithi022 2023-07-12T12:00:19.492 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi022 /etc/hosts 2023-07-12T12:00:19.549 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-12T12:00:19.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-12T12:00:19.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi022/smithi055/g' /etc/hosts 2023-07-12T12:00:19.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.22/172.21.15.55/g' /etc/hosts 2023-07-12T12:00:19.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi022/smithi055/g' /etc/hostname 2023-07-12T12:00:19.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-12T12:00:19.905 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-12T12:00:19.986 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:00:19.986 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:00:19.986 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2023-07-12T12:00:19.986 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2023-07-12T12:00:19.986 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:00:19.987 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-12T12:00:19.988 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:00:19.988 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:00:19.988 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:00:19.988 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:00:19.989 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-07-12T12:00:19.990 DEBUG:teuthology.parallel:result is None 2023-07-12T12:00:20.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:01:20.640 WARNING:teuthology.provision.fog.smithi061:timed out 2023-07-12T12:01:26.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:01:26.971 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:01:26.972 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:01:27.264 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-07-12T12:01:27.264 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-07-12T12:01:27.282 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061 2023-07-12T12:01:27.283 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061 /etc/hosts 2023-07-12T12:01:27.342 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-07-12T12:01:27.342 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-12T12:01:27.454 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061/smithi061/g' /etc/hosts 2023-07-12T12:01:27.483 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-07-12T12:01:27.550 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061/smithi061/g' /etc/hostname 2023-07-12T12:01:27.619 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-12T12:01:27.687 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-12T12:01:27.746 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:01:27.746 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:01:27.746 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-07-12T12:01:27.746 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:01:27.747 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:01:27.748 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-07-12T12:01:27.748 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:01:27.748 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:01:27.748 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:01:27.748 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:01:27.749 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-07-12T12:01:27.749 DEBUG:teuthology.parallel:result is None 2023-07-12T12:01:27.914 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-07-12T12:01:27.915 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-07-12T12:01:27.915 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T12:01:27.954 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:01:27.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-12T12:01:27.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:01:28.024 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-12T12:01:28.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-12T12:01:28.160 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-07-12T12:01:28.218 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-07-12T12:01:28.219 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-12T12:01:28.277 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:01:28.278 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-12T12:01:28.279 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:01:28.280 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:01:28.280 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:01:28.280 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:01:28.280 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-12T12:01:28.303 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:01:28.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-12T12:01:28.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:01:28.370 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-07-12T12:01:28.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-12T12:01:28.439 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-07-12T12:01:28.497 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-07-12T12:01:28.497 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-12T12:01:28.570 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:01:28.571 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-07-12T12:01:28.572 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:01:28.573 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:01:28.573 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:01:28.573 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:01:28.573 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-12T12:01:28.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:01:28.604 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:01:28.747 INFO:teuthology.dispatcher.supervisor:Running job 7334899 2023-07-12T12:01:28.748 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi/7334899 --name vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} -- /home/teuthworker/archive/vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi/7334899/orig.config.yaml 2023-07-12T12:01:28.753 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi/7334899 2023-07-12T12:01:28.754 INFO:teuthology.dispatcher.supervisor:Job PID: 29192 2023-07-12T12:01:28.754 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T12:03:28.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:03:28.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:05:29.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:05:29.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:07:29.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:07:29.199 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:09:29.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:09:29.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:11:29.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:11:29.550 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:13:29.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:13:29.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:15:29.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:15:29.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:15:29.963 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T12:15:30.080 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T12:15:30.081 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T12:15:30.129 DEBUG:teuthology.nuke:shortname: smithi055 2023-07-12T12:15:30.130 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:15:30.156 DEBUG:teuthology.nuke:shortname: smithi061 2023-07-12T12:15:30.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:15:30.159 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi/7334899', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 11:56:12.607846', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T12:15:30.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-12_07:14:06-fs-wip-vshankar-testing-20230712.041849-testing-default-smithi/7334899', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 11:56:12.606180', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T12:15:30.207 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-12T12:15:30.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:15:30.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:15:30.247 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-12T12:15:30.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:15:30.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:15:30.357 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-12T12:15:30.388 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-12T12:15:30.514 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-07-12T12:15:30.536 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com