2023-07-16T11:01:23.404 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-16T11:01:23.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:01:23.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:01:23.565 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c4d58d8b0>, signals=[15]) 2023-07-16T11:01:23.567 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-07-16T11:01:23.567 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-07-16T11:01:23.568 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-16T11:01:23.596 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-07-16T11:01:23.596 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-07-16T11:01:23.597 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-07-16T11:01:23.598 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-07-16T11:01:23.621 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-07-16T11:01:23.671 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-16T11:01:23.687 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-16T11:01:23.718 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-16T11:01:23.719 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 5} 2023-07-16T11:01:23.733 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-16T11:01:23.733 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 5} 2023-07-16T11:01:23.763 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2023-07-16T11:01:23.763 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:01:23.776 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-07-16T11:01:23.776 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:01:23.838 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-07-16T11:01:23.847 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-07-16T11:01:23.873 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-07-16T11:01:23.887 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-07-16T11:01:23.936 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:01:23.938 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:01:24.051 INFO:teuthology.orchestra.console:Power off smithi175 2023-07-16T11:01:24.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T11:01:24.068 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-16T11:01:24.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T11:01:24.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:24.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:24.206 INFO:teuthology.orchestra.console:Power off for smithi175 completed 2023-07-16T11:01:24.307 INFO:teuthology.orchestra.console:Power on smithi175 2023-07-16T11:01:24.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-16T11:01:24.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:28.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:28.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:32.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:32.448 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-16T11:01:32.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:32.550 INFO:teuthology.orchestra.console:Power on smithi086 2023-07-16T11:01:32.550 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-16T11:01:32.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:32.686 INFO:teuthology.orchestra.console:Power on for smithi175 completed 2023-07-16T11:01:32.787 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-07-16T11:01:32.788 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:01:36.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:40.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:01:40.931 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2023-07-16T11:01:41.032 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-07-16T11:01:41.032 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:01:47.900 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:01:56.115 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:02:03.005 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:02:11.212 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:02:18.116 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:02:26.316 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:02:33.216 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:02:41.432 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:02:48.336 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:02:56.532 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:03:03.444 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:03:11.644 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:03:18.540 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:03:26.741 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:03:33.628 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:03:41.836 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:03:48.712 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:03:56.912 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:04:03.780 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:04:12.000 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-16T11:04:12.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:15.124 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:04:18.864 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:04:21.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:24.208 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:04:30.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:33.264 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:04:33.918 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:04:39.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:42.804 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:04:48.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:48.981 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-07-16T11:04:49.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:51.892 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:04:52.084 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:04:57.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:04:58.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:00.976 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:05:01.136 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:05:06.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:07.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:10.032 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-16T11:05:10.192 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:05:16.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:16.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:19.252 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:05:25.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:28.336 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:05:34.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:05:37.424 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-07-16T11:05:43.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:06:16.072 WARNING:teuthology.provision.fog.smithi086:timed out 2023-07-16T11:06:22.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:06:22.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-16T11:06:22.320 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-16T11:06:22.586 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-07-16T11:06:22.587 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-07-16T11:06:22.648 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 2023-07-16T11:06:22.649 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086 /etc/hosts 2023-07-16T11:06:22.708 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-07-16T11:06:22.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-16T11:06:22.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086/smithi086/g' /etc/hosts 2023-07-16T11:06:22.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-07-16T11:06:22.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086/smithi086/g' /etc/hostname 2023-07-16T11:06:22.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-16T11:06:23.062 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-16T11:06:23.122 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-16T11:06:23.122 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-07-16T11:06:23.122 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-16T11:06:23.123 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-16T11:06:23.124 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-16T11:06:23.125 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-07-16T11:06:23.127 DEBUG:teuthology.parallel:result is None 2023-07-16T11:06:43.448 WARNING:teuthology.provision.fog.smithi175:timed out 2023-07-16T11:06:49.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:06:49.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-16T11:06:49.792 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-16T11:06:50.092 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-07-16T11:06:50.092 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-07-16T11:06:50.112 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-07-16T11:06:50.113 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-07-16T11:06:50.172 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-07-16T11:06:50.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-07-16T11:06:50.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-07-16T11:06:50.319 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-07-16T11:06:50.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-07-16T11:06:50.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-07-16T11:06:50.525 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-07-16T11:06:50.582 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-07-16T11:06:50.583 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-07-16T11:06:50.583 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-07-16T11:06:50.583 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-07-16T11:06:50.583 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-16T11:06:50.584 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T11:06:50.585 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-07-16T11:06:50.585 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T11:06:50.585 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-16T11:06:50.585 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-16T11:06:50.585 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-16T11:06:50.585 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-07-16T11:06:50.586 DEBUG:teuthology.parallel:result is None 2023-07-16T11:06:50.753 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-07-16T11:06:50.754 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-07-16T11:06:50.754 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-16T11:06:50.785 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-07-16T11:06:50.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-16T11:06:50.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:06:50.854 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-07-16T11:06:50.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-16T11:06:50.982 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-07-16T11:06:51.039 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-07-16T11:06:51.040 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-16T11:06:51.096 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-16T11:06:51.097 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-07-16T11:06:51.097 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-16T11:06:51.097 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-16T11:06:51.097 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-07-16T11:06:51.098 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-16T11:06:51.098 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-16T11:06:51.098 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-16T11:06:51.098 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-16T11:06:51.098 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-16T11:06:51.099 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-16T11:06:51.100 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-16T11:06:51.100 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-16T11:06:51.125 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-07-16T11:06:51.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-07-16T11:06:51.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T11:06:51.192 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-07-16T11:06:51.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-07-16T11:06:51.263 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-07-16T11:06:51.320 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-07-16T11:06:51.321 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-07-16T11:06:51.376 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-07-16T11:06:51.377 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-07-16T11:06:51.377 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-07-16T11:06:51.377 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-07-16T11:06:51.377 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-07-16T11:06:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-16T11:06:51.379 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T11:06:51.379 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-07-16T11:06:51.379 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T11:06:51.379 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-16T11:06:51.379 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-16T11:06:51.380 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-16T11:06:51.381 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-07-16T11:06:51.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:06:51.409 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:06:51.507 INFO:teuthology.dispatcher.supervisor:Running job 7341051 2023-07-16T11:06:51.507 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi/7341051 --name vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} -- /home/teuthworker/archive/vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi/7341051/orig.config.yaml 2023-07-16T11:06:51.511 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi/7341051 2023-07-16T11:06:51.512 INFO:teuthology.dispatcher.supervisor:Job PID: 5483 2023-07-16T11:06:51.513 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-16T11:08:51.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:08:51.613 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:10:51.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:10:51.785 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:12:51.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:12:51.963 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:14:52.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:14:52.123 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:16:52.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:16:52.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:18:52.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:18:52.472 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:20:52.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:20:52.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:22:52.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:22:52.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:24:53.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:24:53.018 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:26:53.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:26:53.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:28:53.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:28:53.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:30:53.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:30:53.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:32:53.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:32:53.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:34:54.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:34:54.005 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:36:54.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T11:36:54.169 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T11:36:54.244 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-16T11:36:54.417 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-16T11:36:54.418 INFO:teuthology.nuke:Checking targets against current locks 2023-07-16T11:36:54.472 DEBUG:teuthology.nuke:shortname: smithi086 2023-07-16T11:36:54.473 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-16T11:36:54.488 DEBUG:teuthology.nuke:shortname: smithi175 2023-07-16T11:36:54.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-16T11:36:54.492 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi/7341051', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:01:22.571248', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-16T11:36:54.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-16_09:53:37-fs-wip-vshankar-testing-20230704.040136-testing-default-smithi/7341051', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:01:22.572788', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-16T11:36:54.544 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-16T11:36:54.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T11:36:54.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:36:54.582 INFO:teuthology.orchestra.console:Power off smithi175 2023-07-16T11:36:54.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T11:36:54.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T11:36:54.694 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-16T11:36:54.726 INFO:teuthology.orchestra.console:Power off for smithi175 completed 2023-07-16T11:36:54.851 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-07-16T11:36:54.876 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com