2023-06-26T17:49:04.879 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T17:49:04.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:49:04.881 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:49:24.486 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4e197d8b0>, signals=[15]) 2023-06-26T17:49:24.489 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-06-26T17:49:24.490 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T17:49:24.490 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-06-26T17:49:29.873 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-06-26T17:49:29.874 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T17:49:29.874 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-26T17:49:29.875 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-06-26T17:49:29.898 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-06-26T17:49:29.950 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-26T17:49:29.969 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-26T17:49:29.988 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_8.stream (ID 3) 2023-06-26T17:49:29.988 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 3} 2023-06-26T17:49:30.009 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2023-06-26T17:49:30.009 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 3} 2023-06-26T17:49:30.033 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream 2023-06-26T17:49:30.033 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-06-26T17:49:35.040 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2023-06-26T17:49:35.040 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-26T17:49:40.109 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T17:49:43.249 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T17:49:43.285 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-06-26T17:49:43.295 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-06-26T17:49:48.301 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-26T17:49:48.358 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-06-26T17:49:58.402 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-26T17:49:58.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:50:00.027 INFO:teuthology.orchestra.console:Power off smithi012 2023-06-26T17:50:00.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:50:00.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:03.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:04.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:08.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:08.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:12.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:12.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:17.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:17.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:22.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:22.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:27.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:27.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:28.093 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-26T17:50:28.194 INFO:teuthology.orchestra.console:Power on smithi193 2023-06-26T17:50:28.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T17:50:32.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:33.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:37.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:37.455 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-06-26T17:50:37.557 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-06-26T17:50:37.557 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-26T17:50:37.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:50:42.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:45.712 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:50:47.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:47.963 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-06-26T17:50:48.064 INFO:teuthology.orchestra.console:Power on smithi012 2023-06-26T17:50:48.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T17:50:48.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:51.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:50:56.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:50:59.796 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:51:01.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:51:05.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:10.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:51:13.876 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:51:15.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:51:17.040 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2023-06-26T17:51:17.141 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-06-26T17:51:17.142 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-06-26T17:51:22.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:27.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:30.228 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:51:30.288 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-06-26T17:51:36.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:36.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:39.312 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:51:39.344 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-06-26T17:51:45.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:51:45.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:52:03.696 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:52:03.697 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-06-26T17:52:09.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:52:09.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:52:12.678 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:52:12.784 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-06-26T17:52:18.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:52:18.760 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:18.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:52:18.857 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:19.833 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:19.929 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:20.911 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:20.999 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:31.985 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:31.991 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:43.064 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:43.070 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:49.147 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:49.180 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:53.230 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:53.241 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:54.313 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:54.341 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:55.385 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:55.412 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:56.485 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:56.485 WARNING:teuthology.provision.fog.smithi012:'connect to smithi012.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds 2023-06-26T17:52:56.497 ERROR:teuthology.orchestra.connection:Error authenticating with smithi193.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:52:56.498 WARNING:teuthology.provision.fog.smithi193:'connect to smithi193.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds 2023-06-26T17:53:02.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:53:07.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:53:12.562 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:53:47.124 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:53:53.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:54:01.200 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-26T17:54:07.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:54:18.565 WARNING:teuthology.provision.fog.smithi012:timed out 2023-06-26T17:54:24.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:54:45.206 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T17:54:45.207 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T17:55:00.438 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-06-26T17:55:00.439 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-06-26T17:55:00.463 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-06-26T17:55:00.464 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-06-26T17:55:00.526 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-06-26T17:55:00.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-06-26T17:55:00.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-06-26T17:55:00.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-06-26T17:55:00.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-06-26T17:55:00.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-06-26T17:55:00.935 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-06-26T17:55:00.994 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-06-26T17:55:00.994 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-06-26T17:55:00.994 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-06-26T17:55:00.994 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-06-26T17:55:00.995 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T17:55:00.996 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T17:55:00.996 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-26T17:55:00.996 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-06-26T17:55:00.998 DEBUG:teuthology.parallel:result is None 2023-06-26T17:55:12.209 WARNING:teuthology.provision.fog.smithi193:timed out 2023-06-26T17:55:18.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:55:18.463 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T17:55:18.464 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T17:55:18.717 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-06-26T17:55:18.717 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-06-26T17:55:18.735 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-06-26T17:55:18.735 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-06-26T17:55:18.794 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-26T17:55:18.794 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-26T17:55:18.914 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-06-26T17:55:18.942 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-06-26T17:55:19.009 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-06-26T17:55:19.076 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-26T17:55:19.143 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-26T17:55:19.201 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-06-26T17:55:19.201 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-06-26T17:55:19.201 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-06-26T17:55:19.201 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-06-26T17:55:19.201 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T17:55:19.202 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T17:55:19.203 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-26T17:55:19.203 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-06-26T17:55:19.203 DEBUG:teuthology.parallel:result is None 2023-06-26T17:55:24.367 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-06-26T17:55:24.368 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T17:55:29.389 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-06-26T17:55:29.389 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T17:55:34.414 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-06-26T17:55:34.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-06-26T17:55:34.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:55:39.488 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-06-26T17:55:39.627 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-06-26T17:55:39.687 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-06-26T17:55:39.688 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-06-26T17:55:39.748 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-06-26T17:55:39.749 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-06-26T17:55:39.749 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-06-26T17:55:39.749 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-06-26T17:55:39.749 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-06-26T17:55:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-06-26T17:55:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-26T17:55:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-06-26T17:55:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-26T17:55:39.751 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-06-26T17:55:39.751 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T17:55:39.751 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T17:55:39.751 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-26T17:55:39.752 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-06-26T17:55:44.778 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-06-26T17:55:44.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-06-26T17:55:44.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:55:44.848 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-06-26T17:55:44.983 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-06-26T17:55:45.041 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-06-26T17:55:45.041 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-26T17:55:45.099 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-06-26T17:55:45.100 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-06-26T17:55:45.100 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-06-26T17:55:45.100 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-06-26T17:55:45.100 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-06-26T17:55:45.100 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T17:55:45.101 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T17:55:45.102 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-26T17:55:45.102 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-26T17:55:46.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:55:46.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:55:46.731 INFO:teuthology.dispatcher.supervisor:Running job 7316658 2023-06-26T17:55:46.731 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7316658 --name yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi --description rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} -- /home/teuthworker/archive/yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7316658/orig.config.yaml 2023-06-26T17:55:46.735 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7316658 2023-06-26T17:55:46.736 INFO:teuthology.dispatcher.supervisor:Job PID: 22014 2023-06-26T17:55:46.736 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T17:57:46.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:57:46.739 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:59:48.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:59:48.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:01:52.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:01:52.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:03:55.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:03:55.009 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:06:00.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:06:00.087 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:08:00.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:08:00.149 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:10:02.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:10:02.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:12:07.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:12:07.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:14:12.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:14:12.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:16:14.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:16:14.471 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:18:15.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:18:15.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:20:20.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:20:20.443 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:22:25.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:22:25.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:24:26.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:24:26.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:26:31.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:26:31.932 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:28:34.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T18:28:34.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T18:28:39.918 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T18:28:45.223 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-26T18:28:45.223 INFO:teuthology.nuke:Checking targets against current locks 2023-06-26T18:28:55.276 DEBUG:teuthology.nuke:shortname: smithi012 2023-06-26T18:28:55.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T18:28:55.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7316658', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 17:48:49.076207', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPq82r4jICBSJ/QljRntpki3LAe3Sdj8lD7CaP7FqQKYO7t2x39JQwXlsFaytjB1DlL5kN9qUtTFGMjyFLFESyu3zk2eU3Ty7OyG0eiDMtPEd6loy0n0A9/UTxorRlisNB3O9XeCPYZ/HfN+v+rBGSxBM4CBKtYlOxgT2KvwuKl/E1hCHAC03Ny0IG28vtDZBwtPfEI5VPf2kQcjt/eb6LvZpXxR65ZkbL2ar8Tkg6ebSh8zmA8kO5LqwiLeDpetdsPOo+Z4aNdcn5xlxeUm2rOqcRozezyNT6qM3vRszNN/iD7Iq/xjhcj8LYHCXeJIW97tuusb78W7QovB7pKwJjTnxkQSfZuDLyfyFwfxm35efrgU674uKH6zOXhaKN66jKwEVJvXLt/OPC6QZ3pVyN5gP+/d3QJY8arvdOFCoaofHY9FG7JGyFB3mscycPCkXYs9yaZauAbm37vY/9Sj1tVqaLFhOFsN7Tx7rqED8/Q+GAvFdN0+MQaK4aza8BmoE='} 2023-06-26T18:28:55.306 DEBUG:teuthology.nuke:shortname: smithi193 2023-06-26T18:28:55.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T18:28:55.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_14:34:07-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7316658', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 17:48:49.078565', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0scY42R4NW8dEl4uauaEQ8yvGMY0LUtSkb59xOJnSGpldDnjxqQlUIFa0CeZZ424ydnPp4VEPrVYE2IEDk4LWttx16m3y8+MSuiJhvKTr3r/1xCMxaN44XPiJLPqaGA/XEYtzEXavJnlQ3VJD1qQb1mbYUnCdLQnTvVM3Jqc2ZSkcZ+olZ7DWT0N1B6GvXScgSP+ETUX15rYiy8OCneiMFDeKQsVZpLD9x5fGFEfHK0nRtWQx5oHfhunuvRfsUirZiEQrtOBQj6OLdfNjh9X6ps63R05O+9bPP01kybCFI6rcHe/hHK7N6jWHiPrTr0Jp0B5X+TSzZUNR0Lnz3Lh8IniONDBvUi5eOQHXJXuOipyxaQGwRnzl2FOzaNyoJe20JW29hNMvJNSAY8OS2os5SZhFEKgOXEmDk2thvSX0yQQmE/CkcusuPMK1OeO4c4zRrcbK54/2/sEZ6WyEmhn8Nd7tqqKs5W1V9clbhFcbTQUFnxgWUIgpDAIL9AOGSks='} 2023-06-26T18:28:55.367 INFO:teuthology.orchestra.console:Power off smithi012 2023-06-26T18:28:55.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T18:28:55.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T18:28:55.417 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-26T18:28:55.418 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T18:28:55.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T18:28:55.533 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-06-26T18:28:55.569 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-26T18:29:00.697 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-06-26T18:29:00.705 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com