2023-07-12T01:25:03.250 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T01:25:03.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:25:03.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:25:03.442 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1925497f70>, signals=[15]) 2023-07-12T01:25:03.443 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-07-12T01:25:03.444 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T01:25:03.444 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-07-12T01:25:03.461 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-12T01:25:03.462 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T01:25:03.462 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-12T01:25:03.463 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-07-12T01:25:03.486 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-07-12T01:25:03.487 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T01:25:03.487 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-12T01:25:03.488 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-12T01:25:03.511 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-07-12T01:25:03.528 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T01:25:03.557 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T01:25:03.564 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T01:25:03.564 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 5} 2023-07-12T01:25:03.584 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T01:25:03.600 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T01:25:03.600 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5} 2023-07-12T01:25:03.623 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T01:25:03.623 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-07-12T01:25:03.638 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-07-12T01:25:03.638 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:25:03.654 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2023-07-12T01:25:03.654 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:25:03.668 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-07-12T01:25:03.669 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:25:03.767 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T01:25:03.772 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T01:25:03.803 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T01:25:03.810 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-07-12T01:25:03.829 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-12T01:25:03.837 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-07-12T01:25:03.878 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:25:03.882 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:25:03.898 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:25:04.053 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-12T01:25:04.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:25:04.067 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-12T01:25:04.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:25:04.079 INFO:teuthology.orchestra.console:Power off smithi081 2023-07-12T01:25:04.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:25:04.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:04.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:04.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:04.213 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-12T01:25:04.314 INFO:teuthology.orchestra.console:Power on smithi169 2023-07-12T01:25:04.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T01:25:04.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.119 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.242 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.445 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-12T01:25:12.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.546 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-12T01:25:12.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T01:25:12.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.678 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-07-12T01:25:12.779 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-07-12T01:25:12.780 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:25:16.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:16.567 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2023-07-12T01:25:16.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:16.668 INFO:teuthology.orchestra.console:Power on smithi081 2023-07-12T01:25:16.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T01:25:16.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:20.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:20.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:21.013 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-12T01:25:21.114 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-12T01:25:21.114 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:25:24.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:25.033 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2023-07-12T01:25:25.134 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-07-12T01:25:25.135 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:25:27.932 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:25:36.262 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:25:40.278 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:25:43.068 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:25:51.404 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:25:55.432 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:25:58.204 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:26:06.542 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:26:10.575 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:26:13.342 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:26:21.682 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:26:25.721 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:26:28.479 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:26:36.853 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:26:40.892 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:26:43.622 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:26:52.019 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:26:56.032 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:26:58.804 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:27:07.190 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:27:11.256 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:27:14.024 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:27:22.415 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:27:26.449 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:27:29.227 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:27:37.615 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:27:41.648 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:27:44.421 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:27:52.809 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:27:56.825 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:27:59.606 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:28:08.010 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:28:12.041 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:28:14.787 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:28:23.212 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:28:27.236 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:28:29.990 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:28:38.407 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:28:42.411 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:28:45.160 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-12T01:28:45.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:28:53.575 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:28:57.562 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:29:03.856 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-12T01:29:08.748 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:29:09.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:12.742 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:29:12.913 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-12T01:29:18.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:21.968 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-12T01:29:23.900 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:29:27.923 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:29:27.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:31.024 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-12T01:29:37.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:39.062 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:29:40.112 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-12T01:29:43.089 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:29:46.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:54.201 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:29:58.235 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:30:09.359 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:30:13.392 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:30:24.492 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:30:28.538 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:30:39.639 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:30:43.680 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:30:46.121 WARNING:teuthology.provision.fog.smithi169:timed out 2023-07-12T01:30:52.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:30:52.464 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:30:52.465 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:30:52.726 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-07-12T01:30:52.726 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-07-12T01:30:52.742 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169 2023-07-12T01:30:52.743 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169 /etc/hosts 2023-07-12T01:30:52.799 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-07-12T01:30:52.799 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-12T01:30:52.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hosts 2023-07-12T01:30:52.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-07-12T01:30:53.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hostname 2023-07-12T01:30:53.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-12T01:30:53.154 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-12T01:30:53.210 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:30:53.211 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:30:53.212 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:30:53.213 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:30:53.213 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-07-12T01:30:53.215 DEBUG:teuthology.parallel:result is None 2023-07-12T01:30:54.743 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:30:58.801 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:31:09.888 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:31:13.916 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-07-12T01:31:14.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:31:17.072 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:31:23.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:31:24.984 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:31:26.128 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:31:32.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:31:35.216 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:31:40.092 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:31:41.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:31:44.272 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:31:50.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:31:53.360 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:31:55.204 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:31:59.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:32:02.416 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-07-12T01:32:08.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:32:10.287 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:32:25.376 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:32:40.464 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:32:55.553 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:33:08.436 WARNING:teuthology.provision.fog.smithi081:timed out 2023-07-12T01:33:10.624 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-12T01:33:10.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:13.744 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-12T01:33:14.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:14.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:33:14.776 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:33:15.067 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-07-12T01:33:15.067 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-07-12T01:33:15.085 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-07-12T01:33:15.085 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-07-12T01:33:15.142 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-07-12T01:33:15.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-07-12T01:33:15.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-07-12T01:33:15.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-07-12T01:33:15.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-07-12T01:33:15.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-07-12T01:33:15.485 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-07-12T01:33:15.541 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:33:15.541 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-07-12T01:33:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:33:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:33:15.544 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:33:15.544 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:33:15.544 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-07-12T01:33:15.544 DEBUG:teuthology.parallel:result is None 2023-07-12T01:33:19.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:22.800 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-12T01:33:28.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:31.856 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-12T01:33:37.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:40.912 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-12T01:33:46.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:33:49.968 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-12T01:33:55.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:56.032 WARNING:teuthology.provision.fog.smithi139:timed out 2023-07-12T01:35:02.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:02.403 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:35:02.403 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:35:02.732 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-12T01:35:02.732 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-12T01:35:02.750 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-12T01:35:02.751 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-12T01:35:02.808 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-12T01:35:02.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-12T01:35:02.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-12T01:35:02.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-12T01:35:03.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-12T01:35:03.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-12T01:35:03.165 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-12T01:35:03.221 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:03.221 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:03.221 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:03.222 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:03.223 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:03.224 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-12T01:35:03.224 DEBUG:teuthology.parallel:result is None 2023-07-12T01:35:03.410 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-07-12T01:35:03.411 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T01:35:03.441 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-07-12T01:35:03.441 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T01:35:03.465 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-07-12T01:35:03.465 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T01:35:03.491 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-07-12T01:35:03.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-07-12T01:35:03.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:03.558 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-07-12T01:35:03.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-07-12T01:35:03.690 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-07-12T01:35:03.748 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-07-12T01:35:03.748 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-07-12T01:35:03.804 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:03.806 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:03.807 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:03.807 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:03.807 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-07-12T01:35:03.832 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-07-12T01:35:03.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-12T01:35:03.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:03.897 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-12T01:35:03.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-12T01:35:03.965 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-07-12T01:35:04.022 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-07-12T01:35:04.022 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-12T01:35:04.078 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:04.079 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:04.079 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-07-12T01:35:04.079 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-07-12T01:35:04.079 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-07-12T01:35:04.079 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:04.080 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-07-12T01:35:04.081 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:04.081 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:04.081 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:04.081 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:04.081 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-12T01:35:04.098 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-07-12T01:35:04.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-12T01:35:04.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:04.166 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-07-12T01:35:04.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-12T01:35:04.302 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-07-12T01:35:04.360 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-07-12T01:35:04.364 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-12T01:35:04.418 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:04.418 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:04.418 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-12T01:35:04.418 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:04.419 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:04.420 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:04.421 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:04.421 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-12T01:35:04.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:35:04.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:35:04.555 INFO:teuthology.dispatcher.supervisor:Running job 7334521 2023-07-12T01:35:04.556 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521 --name pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521/orig.config.yaml 2023-07-12T01:35:04.560 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521 2023-07-12T01:35:04.561 INFO:teuthology.dispatcher.supervisor:Job PID: 9869 2023-07-12T01:35:04.561 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T01:37:04.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:37:04.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:39:04.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:39:04.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:41:04.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:41:04.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:43:05.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:43:05.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:45:05.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:45:05.298 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:47:05.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:47:05.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:49:05.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:49:05.619 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:51:05.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:51:05.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:53:05.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:53:05.916 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:55:06.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:55:06.073 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:57:06.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:57:06.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:59:06.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:59:06.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:01:06.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:01:06.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:03:06.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:03:06.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:05:06.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:05:06.689 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:07:06.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:07:06.843 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:09:06.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:09:06.968 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:11:07.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:11:07.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:13:07.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:13:07.175 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:15:07.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:15:07.292 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:17:07.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:17:07.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:19:07.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:19:07.593 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:21:07.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:21:07.757 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:23:07.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:23:07.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:25:08.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:25:08.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:27:08.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T02:27:08.149 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T02:27:08.209 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T02:27:08.410 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T02:27:08.411 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T02:27:08.466 DEBUG:teuthology.nuke:shortname: smithi081 2023-07-12T02:27:08.466 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T02:27:08.493 DEBUG:teuthology.nuke:shortname: smithi139 2023-07-12T02:27:08.493 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T02:27:08.494 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:25:02.402279', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T02:27:08.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:25:02.403464', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T02:27:08.521 DEBUG:teuthology.nuke:shortname: smithi169 2023-07-12T02:27:08.521 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T02:27:08.545 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:25:02.400460', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T02:27:08.552 INFO:teuthology.orchestra.console:Power off smithi081 2023-07-12T02:27:08.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T02:27:08.566 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-12T02:27:08.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T02:27:08.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T02:27:08.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T02:27:08.612 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-12T02:27:08.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T02:27:08.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T02:27:08.696 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2023-07-12T02:27:08.720 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-12T02:27:08.750 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-12T02:27:08.851 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-07-12T02:27:08.867 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-07-12T02:27:08.900 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com