2023-07-22T11:55:46.714 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-22T11:55:46.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:55:46.716 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:55:46.881 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f766bc728b0>, signals=[15]) 2023-07-22T11:55:46.883 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-07-22T11:55:46.883 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T11:55:46.884 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-07-22T11:55:46.913 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-07-22T11:55:46.913 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T11:55:46.914 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-07-22T11:55:46.915 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-07-22T11:55:46.937 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-07-22T11:55:46.996 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-22T11:55:47.009 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-22T11:55:47.037 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-22T11:55:47.038 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5} 2023-07-22T11:55:47.048 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-22T11:55:47.049 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 5} 2023-07-22T11:55:47.081 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-07-22T11:55:47.082 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:55:47.094 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of rhel 8.6 2023-07-22T11:55:47.094 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:55:47.160 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T11:55:47.164 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T11:55:47.198 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-07-22T11:55:47.207 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-07-22T11:55:47.260 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:55:47.264 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:55:47.353 INFO:teuthology.orchestra.console:Power off smithi057 2023-07-22T11:55:47.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T11:55:47.373 INFO:teuthology.orchestra.console:Power off smithi204 2023-07-22T11:55:47.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T11:55:47.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:47.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:51.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:51.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:55.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:55.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:55.737 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-07-22T11:55:55.750 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2023-07-22T11:55:55.839 INFO:teuthology.orchestra.console:Power on smithi057 2023-07-22T11:55:55.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T11:55:55.852 INFO:teuthology.orchestra.console:Power on smithi204 2023-07-22T11:55:55.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T11:55:55.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:55.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:59.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:55:59.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:56:04.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:56:04.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:56:04.215 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2023-07-22T11:56:04.272 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2023-07-22T11:56:04.317 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-07-22T11:56:04.318 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:56:04.373 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-07-22T11:56:04.373 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:56:19.392 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:56:19.436 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:56:34.472 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:56:34.503 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:56:49.548 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:56:49.566 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:57:04.636 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:57:04.644 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:57:19.712 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:57:19.713 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:57:34.792 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:57:34.793 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:57:49.864 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:57:49.865 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:58:04.944 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:58:04.945 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:58:20.027 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:58:20.029 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:58:35.116 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:58:35.117 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:58:50.192 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-22T11:58:50.193 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-07-22T11:58:50.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:58:50.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:08.657 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:08.660 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T11:59:14.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:14.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:17.748 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:17.749 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T11:59:23.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:23.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:26.832 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:26.833 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T11:59:32.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:32.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:35.888 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T11:59:35.892 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:41.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:41.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:44.976 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:44.977 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T11:59:50.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:50.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:59:54.032 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-22T11:59:54.036 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T12:00:00.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:00:00.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:00:03.120 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-07-22T12:00:09.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:01:00.092 WARNING:teuthology.provision.fog.smithi204:timed out 2023-07-22T12:01:06.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:01:06.414 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T12:01:06.415 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T12:01:06.699 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-07-22T12:01:06.700 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-07-22T12:01:06.717 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2023-07-22T12:01:06.717 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2023-07-22T12:01:06.775 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-07-22T12:01:06.775 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-07-22T12:01:06.917 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2023-07-22T12:01:06.945 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-07-22T12:01:07.012 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2023-07-22T12:01:07.078 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-07-22T12:01:07.144 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-07-22T12:01:07.200 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-07-22T12:01:07.200 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-07-22T12:01:07.201 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-22T12:01:07.202 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-22T12:01:07.203 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-07-22T12:01:07.205 DEBUG:teuthology.parallel:result is None 2023-07-22T12:01:09.127 WARNING:teuthology.provision.fog.smithi057:timed out 2023-07-22T12:01:15.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:01:15.357 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T12:01:15.357 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T12:01:15.662 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-07-22T12:01:15.662 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-07-22T12:01:15.681 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-07-22T12:01:15.681 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-07-22T12:01:15.739 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-07-22T12:01:15.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-07-22T12:01:15.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-07-22T12:01:15.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-07-22T12:01:15.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-07-22T12:01:16.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-07-22T12:01:16.104 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-07-22T12:01:16.162 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-07-22T12:01:16.162 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-07-22T12:01:16.162 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-07-22T12:01:16.162 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-07-22T12:01:16.163 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-07-22T12:01:16.163 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-07-22T12:01:16.163 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-22T12:01:16.164 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-07-22T12:01:16.164 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-22T12:01:16.164 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-07-22T12:01:16.164 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-22T12:01:16.165 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T12:01:16.165 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-07-22T12:01:16.165 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T12:01:16.165 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-22T12:01:16.166 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-22T12:01:16.166 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-22T12:01:16.168 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-07-22T12:01:16.169 DEBUG:teuthology.parallel:result is None 2023-07-22T12:01:16.324 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-07-22T12:01:16.325 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T12:01:16.350 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-07-22T12:01:16.350 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T12:01:16.376 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-07-22T12:01:16.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-07-22T12:01:16.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:01:16.443 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-07-22T12:01:16.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-07-22T12:01:16.510 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-07-22T12:01:16.567 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-07-22T12:01:16.568 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-07-22T12:01:16.625 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-07-22T12:01:16.626 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-07-22T12:01:16.626 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-07-22T12:01:16.627 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-07-22T12:01:16.627 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-07-22T12:01:16.627 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-07-22T12:01:16.627 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-07-22T12:01:16.628 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T12:01:16.629 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-22T12:01:16.629 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-22T12:01:16.629 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-22T12:01:16.629 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-07-22T12:01:16.650 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-07-22T12:01:16.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-07-22T12:01:16.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T12:01:16.718 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-07-22T12:01:16.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-07-22T12:01:16.789 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-07-22T12:01:16.846 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-07-22T12:01:16.846 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-07-22T12:01:16.904 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-07-22T12:01:16.904 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-07-22T12:01:16.904 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-07-22T12:01:16.904 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-22T12:01:16.905 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T12:01:16.906 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-07-22T12:01:16.906 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T12:01:16.906 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-22T12:01:16.906 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-22T12:01:16.906 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-22T12:01:16.907 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-07-22T12:01:16.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:01:16.925 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:01:17.021 INFO:teuthology.dispatcher.supervisor:Running job 7347576 2023-07-22T12:01:17.022 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347576 --name yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/crash} -- /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347576/orig.config.yaml 2023-07-22T12:01:17.025 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347576 2023-07-22T12:01:17.026 INFO:teuthology.dispatcher.supervisor:Job PID: 31232 2023-07-22T12:01:17.026 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-22T12:03:17.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:03:17.125 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:05:17.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:05:17.297 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:07:17.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:07:17.465 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:09:17.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:09:17.640 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:11:17.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:11:17.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:13:17.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:13:17.995 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:15:18.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:15:18.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:17:18.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:17:18.368 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:19:18.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:19:18.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:21:18.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:21:18.708 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:21:18.779 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-22T12:21:18.870 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-22T12:21:18.870 INFO:teuthology.nuke:Checking targets against current locks 2023-07-22T12:21:18.929 DEBUG:teuthology.nuke:shortname: smithi057 2023-07-22T12:21:18.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T12:21:18.947 DEBUG:teuthology.nuke:shortname: smithi204 2023-07-22T12:21:18.947 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T12:21:18.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347576', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 11:55:45.899376', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-22T12:21:18.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347576', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 11:55:45.897751', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-22T12:21:19.014 INFO:teuthology.orchestra.console:Power off smithi204 2023-07-22T12:21:19.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T12:21:19.030 INFO:teuthology.orchestra.console:Power off smithi057 2023-07-22T12:21:19.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T12:21:19.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T12:21:19.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T12:21:19.159 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2023-07-22T12:21:19.171 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-07-22T12:21:19.312 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com 2023-07-22T12:21:19.319 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com