2023-06-29T19:30:26.356 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-29T19:30:26.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:30:26.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:30:26.510 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f201f417ee0>, signals=[15]) 2023-06-29T19:30:26.512 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-06-29T19:30:26.512 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:30:26.512 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-29T19:30:26.539 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-06-29T19:30:26.539 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:30:26.540 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-29T19:30:26.541 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-06-29T19:30:26.564 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-06-29T19:30:26.611 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T19:30:26.636 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T19:30:26.660 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T19:30:26.661 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3} 2023-06-29T19:30:26.682 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T19:30:26.682 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 3} 2023-06-29T19:30:26.706 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream 2023-06-29T19:30:26.706 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:30:26.724 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2023-06-29T19:30:26.724 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:30:26.788 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:30:26.795 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:30:26.825 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-06-29T19:30:26.830 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-06-29T19:30:26.880 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:30:26.886 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:30:27.009 INFO:teuthology.orchestra.console:Power off smithi098 2023-06-29T19:30:27.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:30:27.027 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-29T19:30:27.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:30:27.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:27.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:27.162 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-06-29T19:30:27.173 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-29T19:30:27.263 INFO:teuthology.orchestra.console:Power on smithi098 2023-06-29T19:30:27.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:30:27.275 INFO:teuthology.orchestra.console:Power on smithi192 2023-06-29T19:30:27.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:30:27.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:27.298 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:31.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:31.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:30:31.524 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-06-29T19:30:31.534 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2023-06-29T19:30:31.625 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-06-29T19:30:31.626 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:30:31.635 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-06-29T19:30:31.636 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:30:46.724 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:30:46.725 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:31:01.815 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:31:01.823 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:31:16.908 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:31:16.910 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:31:32.004 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:31:32.006 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:31:47.108 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:31:47.110 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:32:02.228 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:32:02.230 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:32:17.324 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:32:17.325 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:32:32.424 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:32:32.425 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:32:47.516 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:32:47.518 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:33:02.608 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:33:02.610 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:33:17.687 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:33:17.689 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:33:32.776 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:33:32.777 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:33:47.866 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T19:33:47.868 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-29T19:33:47.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:33:47.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:33:50.992 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T19:33:50.993 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:33:56.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:33:56.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:00.048 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:00.052 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T19:34:06.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:06.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:09.108 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:09.109 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T19:34:15.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:15.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:18.192 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:18.193 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T19:34:24.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:24.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:27.280 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:27.281 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T19:34:33.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:33.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:36.368 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:42.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:45.424 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-29T19:34:51.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:23.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:35:23.248 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:35:33.292 WARNING:teuthology.provision.fog.smithi192:timed out 2023-06-29T19:35:39.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:39.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:35:39.586 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:35:39.829 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-06-29T19:35:39.830 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-06-29T19:35:39.850 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-06-29T19:35:39.851 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-06-29T19:35:39.910 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-06-29T19:35:39.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-06-29T19:35:40.001 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-06-29T19:35:40.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-06-29T19:35:40.100 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-06-29T19:35:40.168 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-06-29T19:35:40.235 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-29T19:35:40.293 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-06-29T19:35:40.293 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-06-29T19:35:40.294 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:35:40.295 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:35:40.296 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:35:40.296 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:35:40.296 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:35:40.297 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-06-29T19:35:40.298 DEBUG:teuthology.parallel:result is None 2023-06-29T19:35:48.042 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-06-29T19:35:48.043 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-06-29T19:35:48.067 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-06-29T19:35:48.067 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-06-29T19:35:48.127 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-06-29T19:35:48.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-29T19:35:48.244 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-06-29T19:35:48.276 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-06-29T19:35:48.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-06-29T19:35:48.414 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-29T19:35:48.481 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-29T19:35:48.539 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-06-29T19:35:48.539 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-06-29T19:35:48.539 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-06-29T19:35:48.539 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:35:48.540 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:35:48.541 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:35:48.541 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:35:48.541 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-06-29T19:35:48.542 DEBUG:teuthology.parallel:result is None 2023-06-29T19:35:48.705 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-06-29T19:35:48.707 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:35:48.738 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-06-29T19:35:48.739 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:35:48.758 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:35:48.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-06-29T19:35:48.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:48.827 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-06-29T19:35:48.851 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-06-29T19:35:48.910 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-06-29T19:35:48.910 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-29T19:35:48.969 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-06-29T19:35:48.969 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-06-29T19:35:48.970 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-06-29T19:35:48.970 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:35:48.970 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-06-29T19:35:48.970 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:35:48.971 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:35:48.971 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-06-29T19:35:48.971 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:35:48.972 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:35:48.972 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:35:48.972 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:35:48.973 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:35:48.974 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-29T19:35:48.997 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:35:48.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-29T19:35:48.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:49.065 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-29T19:35:49.140 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-06-29T19:35:49.200 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-06-29T19:35:49.201 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-29T19:35:49.260 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-06-29T19:35:49.260 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-06-29T19:35:49.260 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:35:49.261 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:35:49.262 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:35:49.262 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:35:49.262 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:35:49.262 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-29T19:35:49.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:35:49.289 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:35:49.384 INFO:teuthology.dispatcher.supervisor:Running job 7321548 2023-06-29T19:35:49.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321548 --name adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} -- /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321548/orig.config.yaml 2023-06-29T19:35:49.390 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321548 2023-06-29T19:35:49.391 INFO:teuthology.dispatcher.supervisor:Job PID: 27457 2023-06-29T19:35:49.392 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-29T19:37:49.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:37:49.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:39:49.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:39:49.677 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:41:49.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:41:49.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:43:50.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:43:50.023 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:45:50.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:45:50.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:47:50.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:47:50.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:49:50.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:49:50.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:51:50.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:51:50.716 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:53:50.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:53:50.889 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:55:51.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:55:51.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:57:51.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:57:51.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:59:51.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:59:51.417 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:01:51.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:01:51.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:03:51.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:03:51.775 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:05:51.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:05:51.957 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:07:52.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:07:52.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:09:52.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:09:52.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:11:52.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:11:52.481 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:13:52.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:13:52.660 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:13:52.732 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-29T20:13:52.829 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-29T20:13:52.830 INFO:teuthology.nuke:Checking targets against current locks 2023-06-29T20:13:52.887 DEBUG:teuthology.nuke:shortname: smithi098 2023-06-29T20:13:52.887 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:13:52.913 DEBUG:teuthology.nuke:shortname: smithi192 2023-06-29T20:13:52.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:13:52.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:30:25.549991', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCPuvqrRq/1cCuwGdc9U8Eu4AVfoP+O/R9Yp8rogwKFZw40DWdudjsTmvp+i0Gl14qQmyfrwShy4AvFgDEi4hP9trlICRxrTi75312LbUf1P8oMnMBm5Xj4YhO3D05RlYFlg2druebG2enF6SmXmuNWRTCIgRKA5CmOyga0wlq7GF9ax6Q6FfBtwsgpOQYPCKiCKofV0MQbYYtAJY+jw1q3TU7kkV0eSY6VIJ2/adNu+m0rIW5UHWgE8s46yaYrmEY+3H2VP+qoEF73lPzdMPFpJJeOBV1IYdYJmJ0PaypdWzxcxcNWo9uHS5oOBZqL5FaWtEaz2V+Aic65lZiOuAYrgwokyuPwW0BfIRoemmL5hwzEnh7T6pyGxJ9ZLevrEZmIZuEN9e4CukwwH6Y2/K6rEvziGE5BZmeITsK7bWqgT9ozTF+HTHE/yn5uCMloXtTWfaWLfVJBYEHyUSB9lgv54/DpH7GVETgCwVW2XUgvLda05GUhv/W4za7wcAJNFE='} 2023-06-29T20:13:52.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:30:25.551459', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6X8QqQzZ7VIvMhsyvfhUUddi4xbyzn/XfHS5sin27jahAnqIUOBz+XyXpIn3mN0aYZV50XrUdw9re0Q7Ewmno='} 2023-06-29T20:13:52.974 INFO:teuthology.orchestra.console:Power off smithi098 2023-06-29T20:13:52.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:13:52.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:13:53.016 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-29T20:13:53.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:13:53.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:13:53.127 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-06-29T20:13:53.159 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-29T20:13:53.281 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-06-29T20:13:53.335 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com