2023-07-11T14:51:09.747 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T14:51:09.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:51:09.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:51:09.900 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f80eab31dc0>, signals=[15]) 2023-07-11T14:51:09.902 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-07-11T14:51:09.902 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:51:09.902 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-11T14:51:09.930 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-11T14:51:09.931 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:51:09.931 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-11T14:51:09.932 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-07-11T14:51:09.954 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-11T14:51:10.004 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T14:51:10.027 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T14:51:10.044 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T14:51:10.045 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 3} 2023-07-11T14:51:10.079 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T14:51:10.079 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-07-11T14:51:10.096 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2023-07-11T14:51:10.096 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:51:10.127 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-07-11T14:51:10.127 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:51:10.172 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:51:10.181 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:51:10.221 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-07-11T14:51:10.230 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-11T14:51:10.281 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:51:10.284 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:51:10.397 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-11T14:51:10.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:51:10.416 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-11T14:51:10.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:51:10.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:10.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:14.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:14.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:18.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:18.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:18.785 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-11T14:51:18.794 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-11T14:51:18.887 INFO:teuthology.orchestra.console:Power on smithi193 2023-07-11T14:51:18.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:51:18.897 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-11T14:51:18.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:51:18.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:18.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:22.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:22.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:23.157 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-11T14:51:23.258 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-11T14:51:23.258 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:51:27.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:51:27.263 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-07-11T14:51:27.364 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-07-11T14:51:27.365 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:51:38.348 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:51:42.449 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:51:53.428 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:51:57.528 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:52:08.512 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:52:12.601 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:52:23.601 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:52:27.685 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:52:38.710 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:52:42.784 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:52:53.800 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:52:57.886 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:53:08.896 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:53:12.980 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:53:23.984 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:53:28.060 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:53:39.080 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:53:43.148 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:53:54.160 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:53:58.232 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:54:09.232 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T14:54:09.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:12.372 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:13.317 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-11T14:54:13.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:16.464 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:54:18.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:21.456 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:22.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:25.524 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:54:27.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:30.516 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:31.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:34.576 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:54:36.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:39.600 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:40.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:43.632 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:54:45.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:48.656 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:49.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:52.688 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:54:54.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:57.712 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:54:58.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:01.744 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-11T14:55:03.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:06.768 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T14:55:07.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:12.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:07.801 WARNING:teuthology.provision.fog.smithi193:timed out 2023-07-11T14:56:12.782 WARNING:teuthology.provision.fog.smithi203:timed out 2023-07-11T14:56:13.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:14.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:56:14.036 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:56:14.329 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-07-11T14:56:14.329 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-07-11T14:56:14.348 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-07-11T14:56:14.348 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-07-11T14:56:14.406 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-11T14:56:14.407 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-11T14:56:14.510 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-07-11T14:56:14.540 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-07-11T14:56:14.609 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-07-11T14:56:14.676 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-11T14:56:14.743 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-11T14:56:14.803 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-07-11T14:56:14.804 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-07-11T14:56:14.804 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-07-11T14:56:14.804 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-07-11T14:56:14.804 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-07-11T14:56:14.804 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T14:56:14.805 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T14:56:14.806 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-07-11T14:56:14.808 DEBUG:teuthology.parallel:result is None 2023-07-11T14:56:18.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:19.104 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:56:19.105 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:56:19.353 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-11T14:56:19.354 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-11T14:56:19.373 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-11T14:56:19.373 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-11T14:56:19.431 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-11T14:56:19.432 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-11T14:56:19.543 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-11T14:56:19.572 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-11T14:56:19.640 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-11T14:56:19.709 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-11T14:56:19.776 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-11T14:56:19.833 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-11T14:56:19.833 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T14:56:19.835 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-11T14:56:19.836 DEBUG:teuthology.parallel:result is None 2023-07-11T14:56:20.020 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-07-11T14:56:20.021 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:56:20.046 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-11T14:56:20.046 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:56:20.071 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:56:20.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-11T14:56:20.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:20.139 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-07-11T14:56:20.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-11T14:56:20.209 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-07-11T14:56:20.270 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-07-11T14:56:20.270 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-11T14:56:20.329 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-07-11T14:56:20.329 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-07-11T14:56:20.329 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-07-11T14:56:20.329 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-07-11T14:56:20.329 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T14:56:20.330 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T14:56:20.331 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-11T14:56:20.353 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:56:20.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T14:56:20.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:20.418 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-11T14:56:20.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T14:56:20.487 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-11T14:56:20.546 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-11T14:56:20.547 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-11T14:56:20.608 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-11T14:56:20.608 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-11T14:56:20.608 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-11T14:56:20.609 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-11T14:56:20.609 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-11T14:56:20.609 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-11T14:56:20.609 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T14:56:20.610 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-11T14:56:20.610 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T14:56:20.610 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-11T14:56:20.611 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T14:56:20.611 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T14:56:20.611 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T14:56:20.612 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-11T14:56:20.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:56:20.637 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:56:20.739 INFO:teuthology.dispatcher.supervisor:Running job 7333896 2023-07-11T14:56:20.740 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333896 --name yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333896/orig.config.yaml 2023-07-11T14:56:20.743 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333896 2023-07-11T14:56:20.744 INFO:teuthology.dispatcher.supervisor:Job PID: 2205 2023-07-11T14:56:20.744 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-11T14:58:20.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:58:20.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:00:20.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:00:20.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:02:21.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:02:21.123 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:04:21.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:04:21.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:06:21.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:06:21.459 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:08:21.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:08:21.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:10:21.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:10:21.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:12:21.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:12:21.896 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:14:22.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:14:22.059 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:16:22.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:16:22.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:18:22.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:18:22.352 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:20:22.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:20:22.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:22:22.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:22:22.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:24:22.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:24:22.801 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:26:22.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:26:22.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:28:23.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:28:23.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:30:23.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:30:23.297 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:32:23.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:32:23.470 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:34:23.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:34:23.615 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:36:23.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:36:23.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:38:23.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:38:23.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:40:24.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:40:24.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:42:24.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:42:24.208 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:44:24.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:44:24.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:46:24.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:46:24.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:46:24.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-11T15:46:24.764 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-11T15:46:24.765 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T15:46:24.816 DEBUG:teuthology.nuke:shortname: smithi193 2023-07-11T15:46:24.817 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:46:24.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:51:08.881480', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMpKYyUs3bFwnYZeaDN7CYFLs4YNp7dBK68kmh2BSoYjZ5KSyEEtYwXrQgcQwy0i0CihpQU++jPL7TvbANy7CbWo8kWIms/m23UIsnyXSZWHHzLVU5EkChkheD/PsVxDic3ZrSlkD4DewXyiC/COosHOZ/ZXILS5tnh8dhzBc/bNJo+2jRaBp1NeS1nPH0sXinboxiWUhqffQfJCYRw6c/IPrPUsAm3UV/Zbl9jDReu/mV1487ukNlEWXvQuhvYfIAyTpcinyEUIEnUtc45wW/LvEcgEnnT+g/FKKJrpvCQZ/t43CueuGLCv/1RNPo9ePe0wccB3s5w4nfIwQcOGJ+w+mKDCTpl8QNjx6gbWJhYEbkXSO2th9aD1cLXGjiugx96R6w4L+oyejnrcCpJFmcDB+ffEqGhwbE/CSbr53Pu1WkhdlJRZtENWrLc5sVqs/+EADHhKysuRsY2KtG+cARQ8xThBRc4hrcbNkv7TIDfngWYtP3YWvxrqAGRkTC7Js='} 2023-07-11T15:46:24.840 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-11T15:46:24.840 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:46:24.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:51:08.879684', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLeOo9EPKuKsOxU+5OS6kdquNrOjBIXAUhVAPrAgrHjh5OP8pl1d6iLg5FJ/tvt/4G9okL86Y/lvUMKgxC/55aI='} 2023-07-11T15:46:24.898 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-11T15:46:24.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:46:24.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:46:24.945 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-11T15:46:24.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:46:24.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:46:25.057 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-11T15:46:25.091 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-11T15:46:25.217 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com 2023-07-11T15:46:25.240 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com