2023-06-28T20:09:59.027 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T20:09:59.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:09:59.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:09:59.208 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4a25fd8b0>, signals=[15]) 2023-06-28T20:09:59.209 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-06-28T20:09:59.209 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T20:09:59.210 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-06-28T20:09:59.235 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-06-28T20:09:59.235 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T20:09:59.235 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-28T20:09:59.237 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /host {"name": "smithi071"} 2023-06-28T20:09:59.259 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-06-28T20:09:59.317 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T20:09:59.330 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T20:09:59.361 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T20:09:59.362 DEBUG:teuthology.provision.fog.smithi071:FOG request: PUT /host/176 {"imageID": 3} 2023-06-28T20:09:59.379 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T20:09:59.380 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 3} 2023-06-28T20:09:59.410 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2023-06-28T20:09:59.411 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:09:59.423 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2023-06-28T20:09:59.423 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:09:59.467 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T20:09:59.482 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T20:09:59.501 DEBUG:teuthology.provision.fog.smithi071:FOG request: POST /host/176/task {"taskTypeID": 1} 2023-06-28T20:09:59.522 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-06-28T20:09:59.551 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:09:59.575 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:09:59.658 INFO:teuthology.orchestra.console:Power off smithi071 2023-06-28T20:09:59.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T20:09:59.685 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-28T20:09:59.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T20:09:59.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:09:59.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:03.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:03.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:08.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:08.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:13.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:13.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:19.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:19.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:24.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:24.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:24.407 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-28T20:10:24.509 INFO:teuthology.orchestra.console:Power on smithi193 2023-06-28T20:10:24.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T20:10:24.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:28.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:29.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:32.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:32.888 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-06-28T20:10:32.989 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-06-28T20:10:32.990 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:10:34.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:39.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:44.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:48.076 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:10:53.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:58.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:10:58.414 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-06-28T20:10:58.516 INFO:teuthology.orchestra.console:Power on smithi071 2023-06-28T20:10:58.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T20:10:58.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:11:02.568 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:11:07.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:11:08.187 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:11:23.299 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2023-06-28T20:11:23.400 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-06-28T20:11:23.400 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:11:38.292 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:11:43.297 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:12:03.391 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:12:03.392 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:12:28.488 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:12:28.489 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:12:43.574 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:12:43.575 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:13:08.672 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:13:08.674 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-06-28T20:13:18.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:13:38.780 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:13:42.128 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-28T20:13:48.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:13:51.184 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-28T20:13:53.851 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-28T20:13:57.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:13:57.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:00.560 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-28T20:14:06.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:15.920 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-28T20:14:21.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:26.933 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-28T20:14:30.000 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-28T20:14:32.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:36.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:36.016 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-06-28T20:14:39.056 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-28T20:14:42.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:47.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:14:52.338 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T20:14:52.338 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T20:15:08.688 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-06-28T20:15:08.689 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-06-28T20:15:08.713 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193 2023-06-28T20:15:08.713 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193 /etc/hosts 2023-06-28T20:15:08.773 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-28T20:15:08.773 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-28T20:15:08.917 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hosts 2023-06-28T20:15:08.948 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-06-28T20:15:09.022 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hostname 2023-06-28T20:15:09.098 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-06-28T20:15:09.167 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-28T20:15:09.225 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-06-28T20:15:09.225 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-06-28T20:15:09.225 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-06-28T20:15:09.226 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T20:15:09.227 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T20:15:09.227 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T20:15:09.227 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-06-28T20:15:09.229 DEBUG:teuthology.parallel:result is None 2023-06-28T20:15:10.452 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-28T20:15:16.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:15:21.636 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T20:15:21.637 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T20:15:41.518 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-06-28T20:15:41.518 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-06-28T20:15:41.542 INFO:teuthology.orchestra.run.smithi071.stdout:smithi193 2023-06-28T20:15:41.543 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi193 /etc/hosts 2023-06-28T20:15:41.603 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-28T20:15:41.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-06-28T20:15:41.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi193/smithi071/g' /etc/hosts 2023-06-28T20:15:41.773 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.193/172.21.15.71/g' /etc/hosts 2023-06-28T20:15:41.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi193/smithi071/g' /etc/hostname 2023-06-28T20:15:41.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-06-28T20:15:41.980 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-06-28T20:15:42.041 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-06-28T20:15:42.041 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-06-28T20:15:42.041 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-06-28T20:15:42.042 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T20:15:42.043 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T20:15:42.043 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T20:15:42.052 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-06-28T20:15:42.053 DEBUG:teuthology.parallel:result is None 2023-06-28T20:15:42.223 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-06-28T20:15:42.224 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-28T20:15:42.254 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-06-28T20:15:42.255 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-28T20:15:42.280 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-06-28T20:15:42.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-06-28T20:15:42.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:15:42.350 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-06-28T20:15:42.417 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-06-28T20:15:42.475 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-06-28T20:15:42.475 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-06-28T20:15:42.533 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-06-28T20:15:42.533 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-06-28T20:15:42.533 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T20:15:42.534 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-06-28T20:15:42.535 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T20:15:42.535 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T20:15:42.535 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T20:15:42.535 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-06-28T20:15:42.562 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-06-28T20:15:42.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-06-28T20:15:42.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T20:15:42.629 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-06-28T20:15:42.725 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-06-28T20:15:42.784 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-06-28T20:15:42.785 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-06-28T20:15:42.843 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-06-28T20:15:42.843 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-06-28T20:15:42.843 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-06-28T20:15:42.844 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-06-28T20:15:42.844 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-06-28T20:15:42.844 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-06-28T20:15:42.844 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-28T20:15:42.844 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-06-28T20:15:42.845 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-28T20:15:42.845 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-06-28T20:15:42.845 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T20:15:42.845 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T20:15:42.845 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-28T20:15:42.846 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-06-28T20:15:42.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:15:42.871 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:15:42.981 INFO:teuthology.dispatcher.supervisor:Running job 7320782 2023-06-28T20:15:42.981 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7320782 --name adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7320782/orig.config.yaml 2023-06-28T20:15:42.985 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7320782 2023-06-28T20:15:42.987 INFO:teuthology.dispatcher.supervisor:Job PID: 14003 2023-06-28T20:15:42.988 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-28T20:17:43.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:17:43.090 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:19:48.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:19:48.269 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:21:53.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:21:53.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:23:58.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:23:58.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:26:01.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:26:01.640 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:28:03.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:28:03.091 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:30:08.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:30:08.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:32:13.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:32:13.439 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:34:13.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:34:13.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:36:18.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:36:18.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:38:23.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:38:23.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:40:28.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:40:28.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:42:33.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:42:33.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:44:34.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:44:34.298 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:46:39.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:46:39.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:48:39.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:48:39.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:50:44.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:50:44.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:52:45.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:52:45.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:54:50.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T20:54:50.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T20:54:54.256 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-28T20:55:04.409 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-28T20:55:04.409 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T20:55:14.280 DEBUG:teuthology.nuke:shortname: smithi071 2023-06-28T20:55:14.281 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T20:55:14.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7320782', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 20:09:43.934017', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrgKAAKAdZwrwK6P91EOFNix6an4C/E9+dttoOCjbOiCaDg6RNkpvt/j4idmRekAcSKmcB2Q0w6VONikLnbdoEdJzU4F6JxjS6bu7TYy2JsHxcN08G2JXElG/yJJidSjTtVw3JHar4VRK3oAYYNcKapfLbeuuXFV3vV3V+DJR13T4syP+Di+eXMZclkENxS/euRWYeuAejFz8NqBIlaEPSMiGan084OnjU5Vf8CyKadxrSBH9SXQEJTJHC7ckZzTITkF3AdyipTIhzb1agQiq9qJE1CepFrtB2J/r+lOruPGbEa6j3PKqGSlqI1Cacue1TU3yd1Zirdjts/9/DPtnEIEC9Br44wiw2Ei55Hct8EsEC9Md4nvhjr3dAC9mub3ZWjvooP5TEVzB5CLTN6BIwYywty7iKWcJk8YDA6QkiZQV57xDdLjRqQz91/o18ORxfovarDOLEUNyEHk/ha+9f1dZnGK/mLRZZaFiLeRSqM/EufigzSgIPtCnuUnbU9nM='} 2023-06-28T20:55:14.321 DEBUG:teuthology.nuke:shortname: smithi193 2023-06-28T20:55:14.321 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T20:55:14.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-28_15:59:19-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7320782', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 20:09:43.935568', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA4vIAmbxY2jepHxHTkWWy2tyHCge8pVmDmd+ZKwOPdKWmyr/XgrX7rtgKUsXDnGnUo6ncKqqAZIwfjoBE2RRNkQybPwThDbsgndLgJp7dUBY8tUMBcEyGLXIKMqMJEzbEXET6tiw7qgt4wonZuCBP7MjIckR0ANxZ2F+6AEgTRQ47tsC0niGTk+x6408FAa83CIo0Ym17V5zdYxp6Riwj4XjykqjMZGr3F4eumAYrn7SmoI0SNOicPEs75BHYgQNktS9bed56xW3A0ripO7WdTEHNAEQvWt+G5J7pw+sUZKMfGoYYDufUrXv/O9kcz+FN/2yuXpwfeqoa3wLpOdJocM8S4eHQQCT83hYCfCOmfMDUqN8roiQfCzqccR6JyNS3UJKyIgjpnqbxNv9L0jnyh/0wgLX2en+edT0DZP7H0cWGTsk+Pn3GfKivWCzmLHhr7JQ9XXiY+Yl1ukEkDKiyZgyR4jw6xisn8m/y6cCkg9pxzlTsM9Y7LcX2B1pgdWs='} 2023-06-28T20:55:14.360 INFO:teuthology.orchestra.console:Power off smithi071 2023-06-28T20:55:14.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T20:55:14.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:55:14.403 INFO:teuthology.orchestra.console:Power off smithi193 2023-06-28T20:55:14.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T20:55:14.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T20:55:14.516 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-06-28T20:55:14.551 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-06-28T20:55:24.684 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com 2023-06-28T20:55:24.693 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com