2023-07-20T18:14:31.873 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T18:14:31.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:14:31.875 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:14:32.089 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4828afe8b0>, signals=[15]) 2023-07-20T18:14:32.093 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-07-20T18:14:32.094 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T18:14:32.094 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-20T18:14:32.351 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-20T18:14:32.352 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T18:14:32.353 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-20T18:14:32.356 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-07-20T18:14:32.387 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-07-20T18:14:32.387 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T18:14:32.387 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-20T18:14:32.391 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-20T18:14:32.412 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-07-20T18:14:32.429 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T18:14:32.467 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T18:14:32.471 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T18:14:32.472 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5} 2023-07-20T18:14:32.490 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T18:14:32.521 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T18:14:32.521 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 5} 2023-07-20T18:14:32.525 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6 2023-07-20T18:14:32.525 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:14:32.529 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T18:14:32.530 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 5} 2023-07-20T18:14:32.583 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of rhel 8.6 2023-07-20T18:14:32.583 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:14:32.587 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.6 2023-07-20T18:14:32.587 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:14:32.601 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T18:14:32.636 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-07-20T18:14:32.653 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T18:14:32.656 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T18:14:32.697 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-20T18:14:32.700 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-07-20T18:14:32.703 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:14:32.756 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:14:32.774 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:14:32.822 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-20T18:14:32.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:14:32.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:32.870 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-20T18:14:32.870 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:14:32.885 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-20T18:14:32.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:14:32.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:32.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:33.006 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-20T18:14:33.023 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-20T18:14:33.034 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-20T18:14:33.108 INFO:teuthology.orchestra.console:Power on smithi062 2023-07-20T18:14:33.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T18:14:33.124 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-20T18:14:33.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T18:14:33.136 INFO:teuthology.orchestra.console:Power on smithi101 2023-07-20T18:14:33.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T18:14:33.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:33.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:33.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:37.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:37.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:37.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:37.396 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-07-20T18:14:37.497 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-07-20T18:14:37.498 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:14:41.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:41.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:14:41.519 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-20T18:14:41.529 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-07-20T18:14:41.624 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-20T18:14:41.625 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:14:41.631 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-07-20T18:14:41.632 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:14:52.588 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:14:56.720 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:14:56.722 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:15:07.680 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:15:11.791 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:15:11.793 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:15:22.764 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:15:26.860 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:15:26.862 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:15:37.844 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:15:41.948 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:15:41.950 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:15:52.921 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:15:57.012 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:15:57.022 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:16:08.124 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:16:12.072 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:16:12.083 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:16:23.184 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:16:27.131 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:16:27.135 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:16:38.252 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:16:42.184 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:16:42.186 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:16:53.314 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:16:57.241 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:16:57.243 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:17:08.376 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:17:12.296 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:17:12.298 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:17:23.437 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-20T18:17:23.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:26.544 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-20T18:17:27.344 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:17:27.355 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-20T18:17:27.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:30.480 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:17:32.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:35.600 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-20T18:17:36.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:39.541 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:17:41.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:42.401 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:17:44.656 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-20T18:17:45.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:48.624 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:17:50.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:53.712 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-20T18:17:54.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:57.462 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-20T18:17:57.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:17:57.680 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:17:59.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:00.592 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:02.768 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-20T18:18:03.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:06.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:06.736 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:18:08.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:09.648 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:12.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:15.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:15.792 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-20T18:18:18.704 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:21.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:24.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:27.760 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:33.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:36.820 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:42.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:45.908 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:18:51.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:18:54.992 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-20T18:19:00.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:19:08.780 WARNING:teuthology.provision.fog.smithi062:timed out 2023-07-20T18:19:14.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:19:15.018 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T18:19:15.019 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T18:19:15.332 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-07-20T18:19:15.332 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-07-20T18:19:15.353 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-07-20T18:19:15.353 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-07-20T18:19:15.412 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-07-20T18:19:15.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-20T18:19:15.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-07-20T18:19:15.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-07-20T18:19:15.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-07-20T18:19:15.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-20T18:19:15.779 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-20T18:19:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-07-20T18:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:19:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:19:15.840 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:19:15.840 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:19:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-07-20T18:19:15.841 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:19:15.842 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:19:15.842 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:19:15.842 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:19:15.843 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-07-20T18:19:15.844 DEBUG:teuthology.parallel:result is None 2023-07-20T18:19:21.804 WARNING:teuthology.provision.fog.smithi101:timed out 2023-07-20T18:19:27.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:19:28.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T18:19:28.168 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T18:19:28.463 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-07-20T18:19:28.464 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-07-20T18:19:28.482 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-07-20T18:19:28.483 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-07-20T18:19:28.541 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-07-20T18:19:28.541 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-20T18:19:28.659 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-07-20T18:19:28.687 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-07-20T18:19:28.754 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-07-20T18:19:28.822 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-20T18:19:28.888 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-20T18:19:28.944 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:19:28.944 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:19:28.944 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:19:28.945 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:19:28.946 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:19:28.946 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:19:28.946 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-07-20T18:19:28.950 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:19:28.951 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:19:28.951 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:19:28.951 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:19:28.951 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-07-20T18:19:28.952 DEBUG:teuthology.parallel:result is None 2023-07-20T18:20:01.028 WARNING:teuthology.provision.fog.smithi090:timed out 2023-07-20T18:20:07.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:20:07.264 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T18:20:07.264 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T18:20:07.543 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-07-20T18:20:07.544 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-07-20T18:20:07.562 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-07-20T18:20:07.562 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-07-20T18:20:07.620 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-07-20T18:20:07.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-20T18:20:07.753 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-07-20T18:20:07.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-07-20T18:20:07.852 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-07-20T18:20:07.919 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-20T18:20:07.985 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-20T18:20:08.042 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:20:08.042 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:20:08.042 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-07-20T18:20:08.042 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-07-20T18:20:08.042 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:20:08.043 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:20:08.044 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-07-20T18:20:08.044 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:20:08.044 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:20:08.044 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:20:08.044 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:20:08.044 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-07-20T18:20:08.045 DEBUG:teuthology.parallel:result is None 2023-07-20T18:20:08.239 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-07-20T18:20:08.240 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-07-20T18:20:08.240 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-07-20T18:20:08.240 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T18:20:08.265 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-07-20T18:20:08.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-20T18:20:08.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:20:08.332 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-07-20T18:20:08.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-20T18:20:08.462 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-07-20T18:20:08.520 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-07-20T18:20:08.520 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-20T18:20:08.578 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:20:08.579 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-07-20T18:20:08.580 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:20:08.581 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:20:08.581 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:20:08.581 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:20:08.581 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-20T18:20:08.605 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-07-20T18:20:08.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-20T18:20:08.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:20:08.671 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-20T18:20:08.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-20T18:20:08.738 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-07-20T18:20:08.796 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-07-20T18:20:08.796 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-20T18:20:08.854 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:20:08.854 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:20:08.854 INFO:teuthology.orchestra.run.smithi090.stdout:ID="rhel" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="fedora" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8.6" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:20:08.855 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:20:08.856 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:20:08.857 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:20:08.857 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-20T18:20:08.880 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-07-20T18:20:08.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-20T18:20:08.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T18:20:08.947 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-07-20T18:20:09.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-20T18:20:09.079 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-07-20T18:20:09.137 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-07-20T18:20:09.137 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-20T18:20:09.194 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T18:20:09.194 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T18:20:09.194 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T18:20:09.195 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T18:20:09.196 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T18:20:09.197 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-20T18:20:09.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:20:09.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:20:09.337 INFO:teuthology.dispatcher.supervisor:Running job 7345395 2023-07-20T18:20:09.337 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395 --name pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395/orig.config.yaml 2023-07-20T18:20:09.342 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395 2023-07-20T18:20:09.343 INFO:teuthology.dispatcher.supervisor:Job PID: 16686 2023-07-20T18:20:09.343 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T18:22:09.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:22:09.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:24:09.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:24:09.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:26:09.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:26:09.793 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:28:09.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:28:09.973 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:30:10.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:30:10.163 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:32:10.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:32:10.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:34:10.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:34:10.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:36:10.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:36:10.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:38:10.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:38:10.885 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:40:11.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:40:11.057 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:42:11.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:42:11.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:44:11.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:44:11.445 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:46:16.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:46:16.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:48:24.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:48:24.005 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:50:29.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:50:29.200 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:52:34.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T18:52:34.385 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T18:52:39.458 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T18:52:52.463 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T18:52:52.463 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T18:52:58.340 DEBUG:teuthology.nuke:shortname: smithi062 2023-07-20T18:52:58.341 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T18:52:58.379 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-20T18:52:58.379 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T18:52:58.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 18:14:30.977950', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T18:52:58.405 DEBUG:teuthology.nuke:shortname: smithi101 2023-07-20T18:52:58.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T18:52:58.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 18:14:30.980854', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T18:52:58.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_16:47:59-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 18:14:30.982782', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T18:52:58.453 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-20T18:52:58.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:52:58.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:52:58.508 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-20T18:52:58.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:52:58.557 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-20T18:52:58.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T18:52:58.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:52:58.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T18:52:58.629 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-20T18:52:58.701 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-20T18:52:58.741 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-20T18:52:58.788 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-07-20T18:52:58.855 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-07-20T18:52:58.897 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com