2023-07-03T07:28:39.985 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-03T07:28:39.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:28:39.987 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:28:40.124 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f48a0f09dc0>, signals=[15]) 2023-07-03T07:28:40.125 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-07-03T07:28:40.125 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T07:28:40.126 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-07-03T07:28:40.146 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-07-03T07:28:40.146 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T07:28:40.147 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-03T07:28:40.148 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"} 2023-07-03T07:28:40.163 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-07-03T07:28:40.344 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-03T07:28:40.346 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-03T07:28:40.395 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3) 2023-07-03T07:28:40.395 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 3} 2023-07-03T07:28:40.398 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3) 2023-07-03T07:28:40.398 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 3} 2023-07-03T07:28:40.460 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream 2023-07-03T07:28:40.461 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:28:40.464 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2023-07-03T07:28:40.465 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:28:40.511 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T07:28:40.517 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T07:28:40.560 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1} 2023-07-03T07:28:40.566 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-07-03T07:28:40.641 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:28:40.653 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:28:40.724 INFO:teuthology.orchestra.console:Power off smithi016 2023-07-03T07:28:40.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T07:28:40.739 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-03T07:28:40.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T07:28:40.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:40.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:40.872 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2023-07-03T07:28:40.880 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-03T07:28:40.974 INFO:teuthology.orchestra.console:Power on smithi016 2023-07-03T07:28:40.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T07:28:40.984 INFO:teuthology.orchestra.console:Power on smithi158 2023-07-03T07:28:40.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T07:28:40.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:41.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:45.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:45.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:45.239 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-07-03T07:28:45.340 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-07-03T07:28:45.340 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:28:49.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:28:49.433 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2023-07-03T07:28:49.534 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-07-03T07:28:49.534 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:29:00.432 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:29:04.623 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:29:15.522 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:29:19.722 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:29:30.613 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:29:34.814 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:29:45.706 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:29:49.910 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:30:00.801 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:30:04.998 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:30:15.876 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:30:20.089 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:30:30.962 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:30:35.173 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:30:46.082 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:30:50.305 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:31:01.203 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:31:05.398 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:31:16.304 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:31:20.480 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-07-03T07:31:20.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:31:31.385 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:31:38.992 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-07-03T07:31:45.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:31:46.470 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:31:48.080 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-07-03T07:31:54.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:31:57.136 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-07-03T07:32:01.555 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:32:03.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:32:06.192 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-07-03T07:32:12.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:32:16.636 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:32:31.711 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-03T07:32:31.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:32:34.864 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:32:40.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:32:43.952 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:32:49.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:32:53.008 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:32:59.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:02.064 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:08.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:11.120 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:12.202 WARNING:teuthology.provision.fog.smithi016:timed out 2023-07-03T07:33:17.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:18.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:18.456 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T07:33:18.457 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T07:33:18.716 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-07-03T07:33:18.716 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-07-03T07:33:18.737 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-07-03T07:33:18.737 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-07-03T07:33:18.797 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-07-03T07:33:18.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-07-03T07:33:18.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-07-03T07:33:18.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-07-03T07:33:19.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-07-03T07:33:19.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-07-03T07:33:19.147 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-07-03T07:33:19.207 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2023-07-03T07:33:19.207 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2023-07-03T07:33:19.207 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2023-07-03T07:33:19.207 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2023-07-03T07:33:19.208 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T07:33:19.209 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T07:33:19.209 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T07:33:19.209 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-07-03T07:33:19.211 DEBUG:teuthology.parallel:result is None 2023-07-03T07:33:20.176 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:29.264 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:35.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:38.320 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:44.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:33:47.408 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-03T07:33:53.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:34:25.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T07:34:25.212 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T07:34:50.305 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-07-03T07:34:50.305 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-07-03T07:34:50.329 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-07-03T07:34:50.330 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-07-03T07:34:50.390 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-07-03T07:34:50.391 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-03T07:34:50.522 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-07-03T07:34:50.554 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-07-03T07:34:50.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-07-03T07:34:50.693 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-03T07:34:50.761 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-03T07:34:50.820 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-03T07:34:50.821 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T07:34:50.822 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T07:34:50.822 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-07-03T07:34:50.823 DEBUG:teuthology.parallel:result is None 2023-07-03T07:34:50.977 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-07-03T07:34:50.978 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T07:34:51.007 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-07-03T07:34:51.007 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T07:34:51.033 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-07-03T07:34:51.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-07-03T07:34:51.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:34:51.102 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-07-03T07:34:51.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-07-03T07:34:51.240 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-07-03T07:34:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-07-03T07:34:51.300 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-07-03T07:34:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2023-07-03T07:34:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2023-07-03T07:34:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2023-07-03T07:34:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2023-07-03T07:34:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T07:34:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T07:34:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T07:34:51.362 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-07-03T07:34:51.382 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-07-03T07:34:51.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-03T07:34:51.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:34:51.446 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-07-03T07:34:51.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-03T07:34:51.516 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-07-03T07:34:51.575 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-07-03T07:34:51.575 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-03T07:34:51.633 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-03T07:34:51.634 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-03T07:34:51.634 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-03T07:34:51.634 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-03T07:34:51.634 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-03T07:34:51.634 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T07:34:51.635 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T07:34:51.636 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T07:34:51.636 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-03T07:34:51.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:34:51.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:34:51.754 INFO:teuthology.dispatcher.supervisor:Running job 7324513 2023-07-03T07:34:51.754 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi/7324513 --name gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi/7324513/orig.config.yaml 2023-07-03T07:34:51.759 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi/7324513 2023-07-03T07:34:51.760 INFO:teuthology.dispatcher.supervisor:Job PID: 19091 2023-07-03T07:34:51.760 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-03T07:36:51.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:36:51.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:38:52.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:38:52.035 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:40:52.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:40:52.217 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:42:52.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:42:52.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:44:52.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:44:52.563 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:46:52.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:46:52.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:48:52.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:48:52.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:50:53.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:50:53.047 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:52:53.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:52:53.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:54:53.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:54:53.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:56:53.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:56:53.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:58:53.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:58:53.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:00:53.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:00:53.914 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:02:54.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:02:54.072 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:04:54.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:04:54.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:06:54.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:06:54.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:08:54.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:08:54.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:10:54.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:10:54.780 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:12:54.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:12:54.962 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:14:55.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:14:55.133 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:16:55.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:16:55.299 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:16:55.367 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-03T08:16:55.540 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-03T08:16:55.540 INFO:teuthology.nuke:Checking targets against current locks 2023-07-03T08:16:55.585 DEBUG:teuthology.nuke:shortname: smithi016 2023-07-03T08:16:55.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T08:16:55.607 DEBUG:teuthology.nuke:shortname: smithi158 2023-07-03T08:16:55.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T08:16:55.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi/7324513', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 07:28:39.217992', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXu+OerTEOBkxxIWhMWWcD3ymj3sR13SJ2YNZQonrcCROV5YSIv4H7YHxkrCu25BBhdV+UuyXpq5wZNrHKB0Lmj9tiRjl5J5XT2r+1yHBMksTEEi/JX7B+vkt92nv5xuFuTiCkWT2qSNWWFlisUBPLeGDd+1FDhAvsB1RFT50YC+zAGmidFe2GoLU6VuGYnKssG5+VZCmbxypkddZ/ZvtyEsnrrKecoqEgt/rNYey9awOw1fZxp6lI/qVJY6kSIBQhsn8puN7ymtTveMKULVb9UYYLM6+5M/3iFo89gMY1rzHfetPedeAVSASFWbjuyJq1apOMCdwKvbll1doFOLnDgzY8G5zN87/6jsKLIsJGkIS+RiUbyQ1qJSS0Z2AyK4wtzQ4bZQR/vp229wN3KSlKTmp9Qb/K8zsINueWDCZiFyX4Y+ALcPy+yconaftzo+9Gj5W2U35NXrcTXr4Jfx6X4k8koV25ua82Q/zVaBu/n2QsRTma6SW3M++xZMrLkbk='} 2023-07-03T08:16:55.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2023-07-03_07:27:35-rgw:verify-trino_tpcds_issues-distro-default-smithi/7324513', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 07:28:39.219966', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq1qS9Sw89zA8Aq10uySWlTS4D5hjNh2IWQyQsHyWTtOFyOYWYbontaOYSBsZmDnqYOdRYRSJgJDSDFUowQPcOtjqmVTJsMCeaz7SbVH+AkbjIdv30pDYdBqGZXOak9FEnp0cm/5jgPqR3BS4yuPmK5JXry+NAtItMtNOKmIVTXxiCkaEkC0ZMyLIWxdDeZKOtEwrV9tl/fnzpWLas5qHy5WfMMlesRKY25nPUTqI3uxqVfiYcx+hfC49M6fMMjMBvsHYPlqZ3SW/HpxzIYnewZhLbF9ks2GnCqQ3ft4rOmCVcRMds9vk1ivp55riva0cwG0JDeV8QwxLbser4Cre5pR59cDNOOVsIplHVF83vNI/NPHvfRdAPyKUQsTqkQbsnCLYK060K10lKmSTUCHYIANioUVOiPm1evy2pc8ekNaZ92hI76GSDN/v282Q4bUsMvaUtXGWDtEcI5z57VWRL5eY+F9sQnNLtY16QmNKggY0jmeGOUTUAO9nja9nkhUM='} 2023-07-03T08:16:55.659 INFO:teuthology.orchestra.console:Power off smithi016 2023-07-03T08:16:55.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:16:55.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:16:55.699 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-03T08:16:55.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:16:55.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:16:55.810 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2023-07-03T08:16:55.840 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-03T08:16:55.967 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-07-03T08:16:55.993 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com