2023-07-21T12:40:02.491 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T12:40:02.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:40:02.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:40:02.650 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f05088e4f70>, signals=[15]) 2023-07-21T12:40:02.651 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-07-21T12:40:02.652 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T12:40:02.652 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-21T12:40:02.676 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-07-21T12:40:02.677 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T12:40:02.678 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-07-21T12:40:02.680 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-07-21T12:40:02.700 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-07-21T12:40:02.753 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T12:40:02.770 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T12:40:02.793 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T12:40:02.793 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 10} 2023-07-21T12:40:02.813 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T12:40:02.813 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 10} 2023-07-21T12:40:02.838 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2023-07-21T12:40:02.838 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:40:02.855 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream 2023-07-21T12:40:02.855 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:40:02.884 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T12:40:02.902 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T12:40:02.917 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-07-21T12:40:02.939 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-07-21T12:40:02.970 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:40:02.986 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:40:03.056 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-21T12:40:03.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T12:40:03.072 INFO:teuthology.orchestra.console:Power off smithi141 2023-07-21T12:40:03.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T12:40:03.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:03.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:07.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:07.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:11.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:11.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:11.431 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-21T12:40:11.439 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2023-07-21T12:40:11.532 INFO:teuthology.orchestra.console:Power on smithi040 2023-07-21T12:40:11.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T12:40:11.541 INFO:teuthology.orchestra.console:Power on smithi141 2023-07-21T12:40:11.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T12:40:11.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:11.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:15.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:15.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:19.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:19.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T12:40:19.959 INFO:teuthology.orchestra.console:Power on for smithi141 completed 2023-07-21T12:40:20.024 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-07-21T12:40:20.061 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-07-21T12:40:20.062 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:40:20.125 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-07-21T12:40:20.125 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:40:35.137 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:40:35.173 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:40:50.208 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:40:50.226 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:41:05.276 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:41:05.278 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:41:20.344 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:41:20.345 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:41:35.420 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:41:35.422 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:41:50.492 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:41:50.493 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:42:05.576 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:42:05.578 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:42:20.656 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:42:20.657 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:42:35.725 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:42:35.726 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:42:50.790 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-21T12:42:50.791 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-21T12:42:50.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:42:50.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:42:53.904 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:42:53.905 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:42:59.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:42:59.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:02.996 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:43:02.997 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:43:09.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:09.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:12.084 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:43:12.085 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:43:18.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:18.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:21.172 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:43:21.173 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:43:27.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:27.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:30.256 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:43:30.257 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:43:36.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:36.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:39.344 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-21T12:43:39.345 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-21T12:43:45.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:43:45.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:44:45.408 WARNING:teuthology.provision.fog.smithi141:timed out 2023-07-21T12:44:45.410 WARNING:teuthology.provision.fog.smithi040:timed out 2023-07-21T12:44:51.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:44:51.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:44:51.600 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T12:44:51.601 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T12:44:51.615 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T12:44:51.615 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T12:44:51.941 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-07-21T12:44:51.941 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-07-21T12:44:51.943 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-07-21T12:44:51.943 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-07-21T12:44:51.960 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-07-21T12:44:51.960 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-07-21T12:44:51.961 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-07-21T12:44:51.962 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-07-21T12:44:52.015 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-07-21T12:44:52.016 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-07-21T12:44:52.017 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-07-21T12:44:52.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-21T12:44:52.119 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-07-21T12:44:52.148 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-07-21T12:44:52.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-07-21T12:44:52.216 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-07-21T12:44:52.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-07-21T12:44:52.283 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-07-21T12:44:52.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-07-21T12:44:52.349 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-07-21T12:44:52.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-21T12:44:52.403 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-07-21T12:44:52.403 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-07-21T12:44:52.404 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-07-21T12:44:52.405 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T12:44:52.405 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-07-21T12:44:52.405 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T12:44:52.405 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T12:44:52.405 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T12:44:52.406 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-07-21T12:44:52.407 DEBUG:teuthology.parallel:result is None 2023-07-21T12:44:52.442 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-21T12:44:52.497 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-07-21T12:44:52.497 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-07-21T12:44:52.497 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-07-21T12:44:52.497 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T12:44:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-07-21T12:44:52.499 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T12:44:52.499 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T12:44:52.499 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T12:44:52.499 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-07-21T12:44:52.500 DEBUG:teuthology.parallel:result is None 2023-07-21T12:44:52.686 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-07-21T12:44:52.686 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T12:44:52.711 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-07-21T12:44:52.711 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T12:44:52.737 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-07-21T12:44:52.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-21T12:44:52.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:44:52.832 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-21T12:44:52.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-21T12:44:52.899 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-07-21T12:44:52.953 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-07-21T12:44:52.954 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-21T12:44:53.008 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-07-21T12:44:53.009 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-07-21T12:44:53.009 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-07-21T12:44:53.009 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-07-21T12:44:53.009 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-07-21T12:44:53.009 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T12:44:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T12:44:53.011 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-21T12:44:53.035 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-07-21T12:44:53.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-07-21T12:44:53.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T12:44:53.119 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-07-21T12:44:53.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-07-21T12:44:53.186 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-07-21T12:44:53.240 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-07-21T12:44:53.240 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-07-21T12:44:53.293 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-07-21T12:44:53.293 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-07-21T12:44:53.294 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T12:44:53.295 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-07-21T12:44:53.295 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T12:44:53.295 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T12:44:53.295 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T12:44:53.295 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-07-21T12:44:53.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:44:53.319 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:44:53.420 INFO:teuthology.dispatcher.supervisor:Running job 7346154 2023-07-21T12:44:53.421 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346154 --name yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} -- /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346154/orig.config.yaml 2023-07-21T12:44:53.425 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346154 2023-07-21T12:44:53.426 INFO:teuthology.dispatcher.supervisor:Job PID: 7728 2023-07-21T12:44:53.426 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T12:46:53.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:46:53.529 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:48:53.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:48:53.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:50:53.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:50:53.873 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:52:54.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:52:54.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:54:54.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:54:54.234 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:56:54.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:56:54.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T12:58:54.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T12:58:54.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:00:54.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:00:54.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:02:54.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:02:54.938 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:04:55.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:04:55.105 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:04:55.174 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T13:04:55.280 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T13:04:55.281 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T13:04:55.332 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-21T13:04:55.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T13:04:55.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 12:40:01.693019', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKnLlpX1D2xbbiK884SyES7pdrTtBTmmwcDiny1xLBPwa5wPx+sg5tZ4BPTftb7fFP9RW5ddv0N0hfVk2R7fhFQ='} 2023-07-21T13:04:55.360 DEBUG:teuthology.nuke:shortname: smithi141 2023-07-21T13:04:55.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T13:04:55.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 12:40:01.690976', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCr8kUpHIBW36KIPT/PwKAFf2xisLhZhq6kJYB3HPbAAzp/fCsU5hGZLajAVDMIeImgt497U3kY7+yRMiwJVYbY='} 2023-07-21T13:04:55.412 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-21T13:04:55.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T13:04:55.431 INFO:teuthology.orchestra.console:Power off smithi141 2023-07-21T13:04:55.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T13:04:55.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:04:55.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:04:55.562 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-21T13:04:55.571 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2023-07-21T13:04:55.707 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-07-21T13:04:55.714 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com