2023-06-20T17:23:07.112 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T17:23:07.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:23:07.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:23:07.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f25730dc8b0>, signals=[15]) 2023-06-20T17:23:07.277 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-06-20T17:23:07.277 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:23:07.278 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-06-20T17:23:07.311 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-06-20T17:23:07.311 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:23:07.312 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-06-20T17:23:07.313 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-06-20T17:23:07.336 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-06-20T17:23:07.401 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:23:07.410 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:23:07.450 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:23:07.450 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-06-20T17:23:07.453 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:23:07.453 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 3} 2023-06-20T17:23:07.489 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-06-20T17:23:07.489 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:23:07.493 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-06-20T17:23:07.493 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:23:07.555 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:23:07.558 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:23:07.591 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-06-20T17:23:07.594 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-06-20T17:23:07.642 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:23:07.645 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:23:07.740 INFO:teuthology.orchestra.console:Power off smithi161 2023-06-20T17:23:07.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:23:07.757 INFO:teuthology.orchestra.console:Power off smithi090 2023-06-20T17:23:07.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:23:07.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:07.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:11.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:11.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:15.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:15.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:16.121 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-06-20T17:23:16.128 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-06-20T17:23:16.223 INFO:teuthology.orchestra.console:Power on smithi161 2023-06-20T17:23:16.223 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:23:16.233 INFO:teuthology.orchestra.console:Power on smithi090 2023-06-20T17:23:16.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:23:16.245 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:16.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:20.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:20.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:24.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:24.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:23:24.595 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2023-06-20T17:23:24.603 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-06-20T17:23:24.697 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-06-20T17:23:24.697 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:23:24.704 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-06-20T17:23:24.705 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:23:39.780 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:23:39.782 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:23:54.860 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:23:54.862 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:24:09.940 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:24:09.942 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:24:25.012 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:24:25.013 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:24:40.096 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:24:40.098 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:24:55.174 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:24:55.176 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:25:10.264 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:25:10.266 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:25:25.356 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:25:25.358 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:25:40.444 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:25:40.446 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:25:55.524 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:25:55.525 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:26:10.628 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-06-20T17:26:10.629 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:26:10.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:25.704 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-20T17:26:25.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:29.232 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:26:35.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:38.288 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:26:44.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:44.336 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:26:47.344 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:26:50.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:53.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:26:53.392 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:26:56.400 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:26:59.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:02.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:02.452 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:27:05.456 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:27:08.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:11.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:11.536 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:27:14.512 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-20T17:27:17.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:20.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:20.592 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:27:26.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:29.648 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:27:35.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:27:38.704 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-20T17:27:44.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:28:20.552 WARNING:teuthology.provision.fog.smithi161:timed out 2023-06-20T17:28:26.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:28:26.760 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:28:26.761 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:28:27.010 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-06-20T17:28:27.011 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-06-20T17:28:27.029 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-06-20T17:28:27.030 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-06-20T17:28:27.089 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-06-20T17:28:27.090 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-06-20T17:28:27.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-06-20T17:28:27.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-06-20T17:28:27.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-06-20T17:28:27.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-06-20T17:28:27.425 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-06-20T17:28:27.483 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-06-20T17:28:27.483 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-06-20T17:28:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:28:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:28:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:28:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:28:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:28:27.486 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-06-20T17:28:27.487 DEBUG:teuthology.parallel:result is None 2023-06-20T17:28:44.724 WARNING:teuthology.provision.fog.smithi090:timed out 2023-06-20T17:28:50.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:28:50.990 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:28:50.991 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:28:51.304 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-06-20T17:28:51.304 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-06-20T17:28:51.323 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-06-20T17:28:51.323 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-06-20T17:28:51.382 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-06-20T17:28:51.382 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-06-20T17:28:51.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-06-20T17:28:51.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-06-20T17:28:51.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-06-20T17:28:51.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-06-20T17:28:51.744 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-06-20T17:28:51.801 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:28:51.802 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:28:51.803 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:28:51.804 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-06-20T17:28:51.804 DEBUG:teuthology.parallel:result is None 2023-06-20T17:28:51.968 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-06-20T17:28:51.969 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:28:51.993 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-06-20T17:28:51.994 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:28:52.012 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:28:52.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-20T17:28:52.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:28:52.079 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-06-20T17:28:52.146 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-06-20T17:28:52.203 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-06-20T17:28:52.204 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-06-20T17:28:52.261 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-06-20T17:28:52.261 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-06-20T17:28:52.262 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:28:52.263 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:28:52.263 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:28:52.263 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:28:52.263 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:28:52.264 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-06-20T17:28:52.285 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:28:52.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-06-20T17:28:52.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:28:52.351 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-06-20T17:28:52.491 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-06-20T17:28:52.549 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-06-20T17:28:52.550 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-06-20T17:28:52.608 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:28:52.609 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:28:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:28:52.611 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-06-20T17:28:52.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:28:52.635 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:28:52.730 INFO:teuthology.dispatcher.supervisor:Running job 7309175 2023-06-20T17:28:52.731 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_bcs-ceph@teuthology --archive /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309175 --name bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309175/orig.config.yaml 2023-06-20T17:28:52.734 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309175 2023-06-20T17:28:52.735 INFO:teuthology.dispatcher.supervisor:Job PID: 11179 2023-06-20T17:28:52.735 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T17:30:52.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:30:52.833 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:32:53.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:32:53.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:34:53.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:34:53.185 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:36:53.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:36:53.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:38:53.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:38:53.547 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:40:53.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:40:53.719 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:42:53.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:42:53.905 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:44:54.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:44:54.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:46:54.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:46:54.247 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:48:54.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:48:54.497 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:50:54.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:50:54.670 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:52:54.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:52:54.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:52:54.927 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T17:52:55.019 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T17:52:55.019 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T17:52:55.065 DEBUG:teuthology.nuke:shortname: smithi090 2023-06-20T17:52:55.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T17:52:55.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309175', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:23:06.302934', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWIaG7ONvbVCoIm74KlOqa5cuIhf/O6vIbJvinC5nwC0MGp23lrqEU0+BrMJA0J8+YRpj2FsN1CRniBWu4aQPqQmJaLiajFlAlF+4Q8C4ot6AqxViYoQEWnN8SrBre9ECo/04y3NhP48qPMz1OtvVxBhMcrqj5/YEtpdcL+igerrahS5yYY3++1+Nk34MPkY+GH7MfhFLzV9JDaXS122NsnQtxl/OXE1jIO2clbA96pXiOxkBUCd7mg9AHa2bBi2zPMD+DhVPY3iuF/kYuYtZT4ZJXty2KBNjd+2yKt4FsDpIHBNwPqrl1edOUrzs68b0F2UQ2ECSdrvC1lYuJH6vuLNPcArFvolPMU+mW2feVsCGlPIO7ao5cEHKLh+hthhGMN4obhAoMLfY8kTNPq7x+tAE2uLZ4DRCnDAJNf1ZfI7upUgUThcyZA1YviH+DuhJitwYfFDAInVwn10aranm3R6w+cZCWw0iiriWM2B5YcB5TFtpzCKp5WQBz+3bW4M8='} 2023-06-20T17:52:55.094 DEBUG:teuthology.nuke:shortname: smithi161 2023-06-20T17:52:55.094 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T17:52:55.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309175', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:23:06.305119', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsoVM2YMuMeC6pjxn3/Br2cUjPXvxTaDkKvAWXuHF5U0a2amY/Hu3rkiEam46ntvVySTpFA7vAPTClvnmf0rylYNltsYHHD8k5smZZD8YH4f9mw76QBGANVvuFPa1qtll9sJoO3In2/IEvcZ0aucvXa8+yCBUvAWCb0f9rEAwUFQECjRL2mFcKrccgjP0eipqdQB0WCx4tSF+1SfSiEIhz38RFrblc6iBByiYTI1Sw35OkoilfAVAgo/WJw2OEoP2BuuhNIEmjcQVBHUtZFpMa4zn4i1Xts1mNglOD4+1BOqx4Pc9JnE5BKC0GAV36GaCM1WCfTMKzo7wLE4741rTd/VcAN41mRLHB++bhLoM3zir6ugN2JbhZnDJXWF+b4u9ny/xj7U+4cY7rCaHq5+MnOhzIFXK39Wr+K8qIb7R0DHxJTN+tacm8OMZREJjBt0oo6I+AQnljYCe7bIWcAfVRoTB0wBOX+KYdrtHGrpQ028rPm4Dk6e+3FMY9VQfjxMk='} 2023-06-20T17:52:55.144 INFO:teuthology.orchestra.console:Power off smithi090 2023-06-20T17:52:55.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:52:55.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:52:55.191 INFO:teuthology.orchestra.console:Power off smithi161 2023-06-20T17:52:55.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:52:55.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:52:55.304 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-06-20T17:52:55.341 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-06-20T17:52:55.459 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-06-20T17:52:55.493 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com