2023-06-23T00:50:44.312 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T00:50:44.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:50:44.315 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:50:44.462 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6344d7e8b0>, signals=[15]) 2023-06-23T00:50:44.464 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-06-23T00:50:44.464 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:50:44.464 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-23T00:50:44.485 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-06-23T00:50:44.486 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:50:44.486 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-06-23T00:50:44.487 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-06-23T00:50:44.510 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-06-23T00:50:44.555 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:50:44.586 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:50:44.605 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:50:44.606 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 7} 2023-06-23T00:50:44.633 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:50:44.634 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 7} 2023-06-23T00:50:44.653 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.4 2023-06-23T00:50:44.654 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:50:44.679 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.4 2023-06-23T00:50:44.679 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:50:44.705 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:50:44.727 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:50:44.743 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-06-23T00:50:44.766 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-06-23T00:50:44.791 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:50:44.812 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:50:44.879 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-23T00:50:44.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:50:44.894 INFO:teuthology.orchestra.console:Power off smithi105 2023-06-23T00:50:44.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:50:44.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:44.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:45.026 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-23T00:50:45.034 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-06-23T00:50:45.128 INFO:teuthology.orchestra.console:Power on smithi006 2023-06-23T00:50:45.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:50:45.137 INFO:teuthology.orchestra.console:Power on smithi105 2023-06-23T00:50:45.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:50:45.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:45.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:49.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:49.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:53.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:53.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:50:53.507 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-06-23T00:50:53.515 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2023-06-23T00:50:53.609 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-06-23T00:50:53.610 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:50:53.616 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-06-23T00:50:53.616 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:51:08.680 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:51:08.681 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:51:23.756 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:51:23.758 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:51:38.848 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:51:38.850 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:51:53.928 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:51:53.929 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:52:09.008 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:52:09.009 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:52:24.092 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:52:24.093 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:52:39.177 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:52:39.178 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:52:54.283 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:52:54.284 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:53:09.388 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:53:09.390 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:53:24.480 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-23T00:53:24.481 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:53:24.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:53:39.577 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-06-23T00:53:39.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:53:42.897 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-23T00:53:48.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:53:51.952 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-23T00:53:57.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:53:58.000 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-23T00:54:01.008 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-23T00:54:04.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:07.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:07.056 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-23T00:54:10.064 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-23T00:54:13.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:16.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:16.116 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-23T00:54:19.120 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-23T00:54:22.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:25.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:25.204 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-23T00:54:31.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:54:34.288 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-06-23T00:54:40.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:25.168 WARNING:teuthology.provision.fog.smithi006:timed out 2023-06-23T00:55:31.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:31.467 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:55:31.468 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:55:31.714 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-06-23T00:55:31.715 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-06-23T00:55:31.771 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-06-23T00:55:31.772 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-06-23T00:55:31.829 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-06-23T00:55:31.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-06-23T00:55:31.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-06-23T00:55:31.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-06-23T00:55:32.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-06-23T00:55:32.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-06-23T00:55:32.172 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-06-23T00:55:32.228 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:55:32.228 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:55:32.229 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-06-23T00:55:32.229 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-06-23T00:55:32.229 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4" 2023-06-23T00:55:32.229 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:55:32.230 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:55:32.230 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-23T00:55:32.231 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:55:32.231 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:55:32.231 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:55:32.231 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:55:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-06-23T00:55:32.232 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:55:32.232 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:55:32.232 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:55:32.232 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:55:32.233 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-06-23T00:55:32.234 DEBUG:teuthology.parallel:result is None 2023-06-23T00:55:40.300 WARNING:teuthology.provision.fog.smithi105:timed out 2023-06-23T00:55:46.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:46.611 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:55:46.611 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:55:46.857 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-06-23T00:55:46.857 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-06-23T00:55:46.912 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-06-23T00:55:46.913 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-06-23T00:55:46.967 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-06-23T00:55:46.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-06-23T00:55:47.069 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-06-23T00:55:47.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-06-23T00:55:47.160 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-06-23T00:55:47.224 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-06-23T00:55:47.288 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-06-23T00:55:47.344 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:55:47.345 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:55:47.346 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:55:47.347 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:55:47.347 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:55:47.347 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-06-23T00:55:47.348 DEBUG:teuthology.parallel:result is None 2023-06-23T00:55:47.500 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-06-23T00:55:47.501 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:55:47.524 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-06-23T00:55:47.525 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:55:47.550 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:55:47.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-06-23T00:55:47.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:47.617 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-06-23T00:55:47.735 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-06-23T00:55:47.791 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-06-23T00:55:47.792 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-06-23T00:55:47.847 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:55:47.847 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:55:47.847 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-23T00:55:47.848 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:55:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:55:47.850 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:55:47.850 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:55:47.850 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-23T00:55:47.874 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:55:47.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-06-23T00:55:47.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:47.939 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-06-23T00:55:48.002 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-06-23T00:55:48.056 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-06-23T00:55:48.057 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-06-23T00:55:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:55:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:55:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2023-06-23T00:55:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2023-06-23T00:55:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.4" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:55:48.111 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:55:48.112 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-06-23T00:55:48.112 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:55:48.112 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:55:48.112 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:55:48.112 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:55:48.113 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-06-23T00:55:48.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:55:48.142 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:55:48.247 INFO:teuthology.dispatcher.supervisor:Running job 7311932 2023-06-23T00:55:48.247 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311932 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311932/orig.config.yaml 2023-06-23T00:55:48.251 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311932 2023-06-23T00:55:48.252 INFO:teuthology.dispatcher.supervisor:Job PID: 15441 2023-06-23T00:55:48.253 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T00:57:48.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:57:48.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:59:48.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:59:48.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:01:48.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:01:48.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:03:48.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:03:48.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:05:49.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:05:49.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:07:49.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:07:49.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:09:49.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:09:49.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:11:49.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:11:49.605 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:13:49.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:13:49.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:15:49.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:15:49.955 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:17:50.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:17:50.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:17:50.200 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T01:17:50.333 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T01:17:50.333 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T01:17:50.387 DEBUG:teuthology.nuke:shortname: smithi006 2023-06-23T01:17:50.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:17:50.416 DEBUG:teuthology.nuke:shortname: smithi105 2023-06-23T01:17:50.416 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:17:50.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311932', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:50:43.445630', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUhBw2y+/m3WFOUv11/dzFJP5d3X+xnlBEVpswYwNLROFa1gCulzdk8ptw0KQQn9Z6Y7KeyFRptIX4N0PWgxawLKgXFEFaEoVUTojGvZrqLTZzimORZv79b4RJQKgCeyyxi3bC1v5EvaDKaDjMHSaGzElmYnxt/vbhUOp/KyTANotoiQLC6jStfCbUHkrea59jluuhLrF2Aitgd0Jt97Y5iqZ0EM+jlx5GkA2OLypCNHzM+9Ll/RRINmgH0JtXj0XCF0Ea05LrvsZ0GAlXLGYFjKc53ZgJZHk4qwRUQVJOH+93zTks7AVQGGShnCeTmpp6FCiYk03HchvrQDMAqruYHd7Bb2TKKd6oldEYKKvwzhzk74rk5M15xN/TQfNzJBc/2bdsHyNVpAU23a+lHJ7n2SflAUQACRIscsVerD+jqx9ru0+4KnEUiGKz0uJL4/BS7tgA+hEGD958J7tvsh0qw36lMN1Z/RA6levsDsVCGOcrqD7bvymN6/L28V1ec/U='} 2023-06-23T01:17:50.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311932', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:50:43.443921', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ2tcGB3GQWHPmHXzUMpGra0SXA15QTCCB/ekcmPAD20eBUNCSWiXvDXoTaX10LyYzklb/KrBz7vTA39wDJ0FurJNSsOK9weEnmdmznnHkg5RDS8MK0w7LTHWsrrYCFQ2NgMcrdmy3ROniFCHelMQg5NCmt+90hXkoeL9lIqaRl32DRqoBVAMu9rIDLQ6887X9TbwMPcVredCSOMTqda2lv0tFgZ327nFQ2A6DF+vZe9B6OgLornsDzDVbeVMQ/1BP0NwIgvmugZUrAp6dA00sSOdYQrIqtLTdRuJBaqGx5kri26gNOS5IQXp54iF/vfXegFkpfu2aaL7NuaYf56TcH7aRXwDetDTjHpFFkUK32M+zzMeCYm2kXTCA1TlW7AHr+7c5UNSZPoBdexruolo6jXtzlkWC0HGHtRT1U27HWBfy/6+4bNHfB+sNdPjyZRJYjSzEfGkiqKrveRAggcVSO9GzXT9AJH/brTZz/sHABXXd9mOuwvj5X5Ukeg8ryus='} 2023-06-23T01:17:50.477 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-23T01:17:50.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:17:50.503 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:17:50.527 INFO:teuthology.orchestra.console:Power off smithi105 2023-06-23T01:17:50.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:17:50.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:17:50.640 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-23T01:17:50.680 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-06-23T01:17:50.790 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-06-23T01:17:50.832 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com