2023-06-28T18:32:10.203 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T18:32:10.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:32:10.205 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:32:10.355 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ca7b6f430>, signals=[15]) 2023-06-28T18:32:10.356 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-06-28T18:32:10.357 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:32:10.357 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-28T18:32:10.384 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-06-28T18:32:10.384 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:32:10.384 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-06-28T18:32:10.386 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-06-28T18:32:10.409 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-06-28T18:32:10.462 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T18:32:10.476 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T18:32:10.506 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T18:32:10.507 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 3} 2023-06-28T18:32:10.519 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T18:32:10.519 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-06-28T18:32:10.552 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream 2023-06-28T18:32:10.552 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-28T18:32:10.560 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-06-28T18:32:10.560 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-06-28T18:32:10.661 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:32:10.669 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:32:10.710 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-06-28T18:32:10.712 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-06-28T18:32:10.772 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-06-28T18:32:10.777 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-28T18:32:10.911 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-28T18:32:10.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:32:10.925 INFO:teuthology.orchestra.console:Power off smithi186 2023-06-28T18:32:10.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:32:10.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:10.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:14.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:14.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:20.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:20.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:25.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:25.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:30.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:30.298 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:35.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:35.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:35.620 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-06-28T18:32:35.721 INFO:teuthology.orchestra.console:Power on smithi186 2023-06-28T18:32:35.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:32:35.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:39.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:40.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:44.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:45.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:45.836 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-28T18:32:45.937 INFO:teuthology.orchestra.console:Power on smithi114 2023-06-28T18:32:45.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:32:45.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:49.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:49.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:55.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:32:55.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:00.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:00.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:05.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:05.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:10.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:10.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:10.645 INFO:teuthology.orchestra.console:Power on for smithi186 completed 2023-06-28T18:33:10.746 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-06-28T18:33:10.746 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-06-28T18:33:15.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:20.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:25.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:33:25.861 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-06-28T18:33:40.974 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2023-06-28T18:33:41.075 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-06-28T18:33:41.075 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-28T18:33:55.980 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-06-28T18:34:01.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:34:06.038 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-28T18:34:11.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:34:24.496 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-06-28T18:34:30.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:34:35.887 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:34:35.889 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:34:36.231 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-06-28T18:34:36.231 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-06-28T18:34:36.248 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-06-28T18:34:36.248 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-06-28T18:34:36.306 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-06-28T18:34:36.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-06-28T18:34:36.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-06-28T18:34:36.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-06-28T18:34:36.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-06-28T18:34:36.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-06-28T18:34:36.664 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-06-28T18:34:36.724 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-06-28T18:34:36.724 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-06-28T18:34:36.724 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-06-28T18:34:36.724 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-06-28T18:34:36.725 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:34:36.726 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:34:36.726 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T18:34:36.727 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-06-28T18:34:36.728 DEBUG:teuthology.parallel:result is None 2023-06-28T18:34:37.114 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:34:37.114 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:34:37.440 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-06-28T18:34:37.440 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-06-28T18:34:37.460 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186 2023-06-28T18:34:37.461 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186 /etc/hosts 2023-06-28T18:34:37.519 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-06-28T18:34:37.520 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186 smithi186 2023-06-28T18:34:37.520 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-06-28T18:34:37.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hosts 2023-06-28T18:34:37.664 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-06-28T18:34:37.752 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hostname 2023-06-28T18:34:37.780 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-06-28T18:34:37.847 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-06-28T18:34:37.905 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-06-28T18:34:37.905 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-06-28T18:34:37.905 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-06-28T18:34:37.906 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:34:37.907 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:34:37.907 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T18:34:37.907 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-06-28T18:34:37.908 DEBUG:teuthology.parallel:result is None 2023-06-28T18:34:43.063 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-06-28T18:34:43.064 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-06-28T18:34:43.064 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-28T18:34:48.095 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-06-28T18:34:48.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-06-28T18:34:48.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:34:48.163 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-06-28T18:34:48.302 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-06-28T18:34:48.361 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-06-28T18:34:48.361 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-06-28T18:34:48.419 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-06-28T18:34:48.419 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T18:34:48.420 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-06-28T18:34:48.421 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T18:34:48.421 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-06-28T18:34:48.421 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:34:48.421 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:34:48.421 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T18:34:48.422 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-28T18:34:53.452 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-06-28T18:34:53.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-06-28T18:34:53.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:34:58.530 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-06-28T18:34:58.671 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-06-28T18:34:58.730 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-06-28T18:34:58.730 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-06-28T18:34:58.788 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-06-28T18:34:58.788 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-06-28T18:34:58.789 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T18:34:58.790 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-06-28T18:34:58.790 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:34:58.790 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:34:58.790 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T18:34:58.790 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-06-28T18:35:01.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:35:01.179 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:35:01.377 INFO:teuthology.dispatcher.supervisor:Running job 7320981 2023-06-28T18:35:01.377 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320981 --name pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi --description rados:mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/progress} -- /home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320981/orig.config.yaml 2023-06-28T18:35:01.381 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320981 2023-06-28T18:35:01.383 INFO:teuthology.dispatcher.supervisor:Job PID: 3785 2023-06-28T18:35:01.383 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-28T18:37:01.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:37:01.468 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:39:06.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:39:06.641 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:41:06.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:41:06.754 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:41:11.820 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-28T18:41:21.932 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-28T18:41:21.932 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T18:41:38.764 DEBUG:teuthology.nuke:shortname: smithi114 2023-06-28T18:41:38.765 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:41:43.796 DEBUG:teuthology.nuke:shortname: smithi186 2023-06-28T18:41:43.797 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:41:48.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:32:09.432083', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuz6r3K3rQQKyDIw6WS28dtOOBjMUAMbYXyNCDksAVhCJrI/6gplAURcvc59ZCYEYw+v0TSoaTXyduBJiCMBGI='} 2023-06-28T18:41:48.830 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-28_17:10:32-rados:mgr-wip-pdonnell-testing-20230627.204243-distro-default-smithi/7320981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:32:09.433702', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Hv96faCL5vUFmA2RydcsHz0t2LOfjsl3tG8zMO675184K8k0bIDzEU2t2pgwJ6ecRxQ2I7YDhKLPkbav43/9FDBGmSqNbBvGBixepZCmb6VaZjhSr3lfGGklqIevuQeNoLdfg1Zq2w6MuCaIuTA66RoI++d3szVIYtyyRjXXTCyqNEsGE7EESxCG8KUN82eCcmqwNxeh1VrzMZZm02LhkSKzWN8sxiWIA8ezNtFUdo/uAiLnqg026U1k8HCvt1mdMIJqvMNlrSXBMz94dr99+eiX5X2StPXWA2Mvd7VyGbG1Uo6/ntZabSxfR/94ivkt3bRsRSpuBXeMVflNYCyAq6AZbhJ3T3GJhPKFvTuWvbGN+8wKaXX1XkYr5svA2omhsfXn+qukS7/Pk24y+5bIEYq8XM9cpGWRebpAcf34o3mx3O6d7zau8IOzefxMtD0Zau51uL40E8gGclhW2mDhLKDrMx8EwbI+CdCP2zJZAPqmn5vPegrIxWWUu4y+u4s='} 2023-06-28T18:41:48.864 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-28T18:41:48.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:41:48.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:41:48.903 INFO:teuthology.orchestra.console:Power off smithi186 2023-06-28T18:41:48.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:41:48.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:41:49.013 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-28T18:41:49.044 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-06-28T18:42:04.120 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-06-28T18:42:04.128 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com