2023-06-23T00:31:59.916 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T00:31:59.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:31:59.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:32:00.073 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f57ddedb430>, signals=[15]) 2023-06-23T00:32:00.074 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-06-23T00:32:00.075 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:32:00.075 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-06-23T00:32:00.096 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-06-23T00:32:00.096 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:32:00.096 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-23T00:32:00.099 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"} 2023-06-23T00:32:00.119 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-06-23T00:32:00.180 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:32:00.198 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:32:00.227 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:32:00.227 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 7} 2023-06-23T00:32:00.233 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:32:00.234 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 7} 2023-06-23T00:32:00.272 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4 2023-06-23T00:32:00.273 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:00.277 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.4 2023-06-23T00:32:00.277 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:32:00.342 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:32:00.349 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:32:00.379 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-06-23T00:32:00.384 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1} 2023-06-23T00:32:00.439 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:00.535 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:32:00.613 INFO:teuthology.orchestra.console:Power off smithi067 2023-06-23T00:32:00.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:32:00.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:00.667 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-23T00:32:00.667 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:32:00.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:00.778 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2023-06-23T00:32:00.815 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-23T00:32:00.879 INFO:teuthology.orchestra.console:Power on smithi067 2023-06-23T00:32:00.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:32:00.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:00.916 INFO:teuthology.orchestra.console:Power on smithi193 2023-06-23T00:32:00.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:32:00.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:04.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:04.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:09.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:09.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:32:09.261 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2023-06-23T00:32:09.300 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-06-23T00:32:09.363 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-06-23T00:32:09.363 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:09.402 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-06-23T00:32:09.402 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:32:24.468 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:24.483 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:32:39.552 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:39.553 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:32:54.636 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:32:54.637 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:33:09.724 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:33:09.726 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:33:24.803 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:33:24.805 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:33:39.888 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:33:39.889 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:33:54.973 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:33:54.974 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:34:10.054 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:34:10.055 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:34:25.144 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:34:25.145 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:34:40.218 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:34:40.220 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:34:55.292 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-23T00:34:55.293 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None 2023-06-23T00:34:55.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:34:55.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:13.904 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-23T00:35:13.905 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-23T00:35:19.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:19.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:22.960 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-23T00:35:22.961 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-23T00:35:28.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:28.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:32.016 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-23T00:35:32.017 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-23T00:35:38.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:38.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:41.076 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-23T00:35:41.104 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-23T00:35:47.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:47.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:35:50.160 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-23T00:35:56.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:36:47.102 WARNING:teuthology.provision.fog.smithi193:timed out 2023-06-23T00:36:53.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:36:53.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:36:53.428 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:36:53.679 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-06-23T00:36:53.680 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-06-23T00:36:53.735 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-06-23T00:36:53.736 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-06-23T00:36:53.789 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-23T00:36:53.789 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-23T00:36:53.899 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-06-23T00:36:53.926 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-06-23T00:36:53.990 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-06-23T00:36:54.056 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-23T00:36:54.120 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-23T00:36:54.173 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:36:54.173 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:36:54.173 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.4" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:36:54.174 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:36:54.175 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:36:54.176 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-06-23T00:36:54.177 DEBUG:teuthology.parallel:result is None 2023-06-23T00:36:56.168 WARNING:teuthology.provision.fog.smithi067:timed out 2023-06-23T00:37:02.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:37:02.551 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:37:02.551 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:37:02.828 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-06-23T00:37:02.829 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2023-06-23T00:37:02.884 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2023-06-23T00:37:02.884 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2023-06-23T00:37:02.939 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-06-23T00:37:02.940 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-06-23T00:37:03.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2023-06-23T00:37:03.086 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2023-06-23T00:37:03.154 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2023-06-23T00:37:03.219 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2023-06-23T00:37:03.283 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-06-23T00:37:03.336 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:37:03.336 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:37:03.336 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:37:03.337 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:37:03.338 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:37:03.339 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-06-23T00:37:03.339 DEBUG:teuthology.parallel:result is None 2023-06-23T00:37:03.520 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-06-23T00:37:03.521 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:37:03.550 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-06-23T00:37:03.550 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:37:03.577 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:37:03.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-06-23T00:37:03.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:37:03.646 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-06-23T00:37:03.712 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-06-23T00:37:03.768 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-06-23T00:37:03.769 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-06-23T00:37:03.823 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:37:03.824 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:37:03.824 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-06-23T00:37:03.824 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-06-23T00:37:03.824 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:37:03.825 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:37:03.826 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-06-23T00:37:03.826 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:37:03.826 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:37:03.826 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:37:03.826 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:37:03.827 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-06-23T00:37:03.849 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:37:03.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-06-23T00:37:03.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:37:03.914 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-06-23T00:37:03.981 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-06-23T00:37:04.037 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-06-23T00:37:04.037 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-23T00:37:04.093 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:37:04.093 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.4" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:37:04.094 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:37:04.095 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:37:04.096 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:37:04.096 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-23T00:37:04.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:37:04.125 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:37:04.232 INFO:teuthology.dispatcher.supervisor:Running job 7311905 2023-06-23T00:37:04.233 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311905 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311905/orig.config.yaml 2023-06-23T00:37:04.236 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311905 2023-06-23T00:37:04.236 INFO:teuthology.dispatcher.supervisor:Job PID: 29323 2023-06-23T00:37:04.237 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T00:39:04.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:39:04.337 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:41:04.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:41:04.517 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:43:04.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:43:04.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:45:04.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:45:04.821 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:47:05.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:47:05.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:49:05.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:49:05.169 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:51:05.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:51:05.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:53:05.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:53:05.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:55:05.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:55:05.703 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:57:05.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:57:05.896 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:59:06.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:59:06.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:59:06.151 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T00:59:06.271 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T00:59:06.271 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T00:59:06.330 DEBUG:teuthology.nuke:shortname: smithi067 2023-06-23T00:59:06.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:59:06.356 DEBUG:teuthology.nuke:shortname: smithi193 2023-06-23T00:59:06.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:59:06.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:31:59.055253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4H9kYa2ObNhjkkcOZjKZqGNYzo8gRvsaDvaYoYKJK/razr0RwRxTp33xPxOYD9fhTEr2xc+pvjViNywMEceSuOtmBu2QrVAiLlLqzcu/RnGqbYmczWHCroKq2E5qr5YprWq8ZIqcDLfJghb8rhdyXbkDxcMr6UAcF4fLohG0jJ9xSbMixL0LcrlE2qPuTQkSBJe3rhQhlWMgFsDTaDqbdHJ73mBPwDArLV39YG33lTzlRxTQHelzezqa6xkvJrSFIiP161+yJnuH62M3mexkNCnRBXzBmxdZAc/gIpJrXMHzrMwHPDcVajpkETswAOvuUuaGNLT7vPyaYXcrSEd3dvQShmxjyinPGrV9CLLABM5tXBgLpX7IkpRZlUGYjCDut9+8yg35/txjFjIz9wa2fMSE+pklbyY9DCAJx4kA2xqGzVmNkrSTnJB9hWhrKJdOzouH+HzE7Uaj5DBaQAVXH3WV41rJ7zaPJDwBDKjLV9/OSweYkdlk0p948jsrFMgE='} 2023-06-23T00:59:06.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:31:59.057275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0UFi1YFBHDRFVPnRJ8fuo2+DwDinOjfXxVdtICtPIhSUZfE7GDA5ypnfxJqtYEvUrSphAENJvPdBp2E/QdUy8='} 2023-06-23T00:59:06.419 INFO:teuthology.orchestra.console:Power off smithi067 2023-06-23T00:59:06.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:59:06.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:59:06.459 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-23T00:59:06.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:59:06.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:59:06.571 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2023-06-23T00:59:06.605 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-23T00:59:06.725 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2023-06-23T00:59:06.758 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com