2023-06-17T14:24:57.222 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-17T14:24:57.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:24:57.224 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:24:57.380 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07504acd30>, signals=[15]) 2023-06-17T14:24:57.381 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-06-17T14:24:57.382 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-06-17T14:24:57.382 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-17T14:24:57.409 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-06-17T14:24:57.410 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-06-17T14:24:57.410 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-06-17T14:24:57.411 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-06-17T14:24:57.434 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-06-17T14:24:57.487 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-17T14:24:57.503 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-17T14:24:57.529 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_8.stream (ID 3) 2023-06-17T14:24:57.529 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 3} 2023-06-17T14:24:57.538 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2023-06-17T14:24:57.538 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 3} 2023-06-17T14:24:57.576 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream 2023-06-17T14:24:57.576 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:24:57.582 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2023-06-17T14:24:57.582 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:24:57.693 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-06-17T14:24:57.699 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-06-17T14:24:57.732 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-06-17T14:24:57.734 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-06-17T14:24:57.796 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:24:57.802 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:24:57.955 INFO:teuthology.orchestra.console:Power off smithi191 2023-06-17T14:24:57.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-17T14:24:57.970 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-17T14:24:57.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-17T14:24:57.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:24:57.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:24:58.100 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-06-17T14:24:58.110 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-17T14:24:58.202 INFO:teuthology.orchestra.console:Power on smithi191 2023-06-17T14:24:58.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-17T14:24:58.211 INFO:teuthology.orchestra.console:Power on smithi139 2023-06-17T14:24:58.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-17T14:24:58.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:24:58.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:25:02.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:25:02.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:25:02.464 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-06-17T14:25:02.565 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-06-17T14:25:02.566 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:25:06.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:25:06.567 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2023-06-17T14:25:06.668 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-06-17T14:25:06.669 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:25:17.712 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:25:21.848 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:25:32.888 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:25:37.004 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:25:48.071 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:25:52.179 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:26:03.244 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:26:07.346 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:26:18.424 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:26:22.525 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:26:33.648 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:26:37.697 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:26:48.871 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:26:52.935 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:27:04.149 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:27:08.203 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:27:19.400 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:27:23.454 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:27:34.704 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:27:38.739 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:27:49.948 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:27:54.332 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:28:05.481 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:28:09.602 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:28:20.788 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:28:24.892 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:28:36.170 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:28:40.155 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:28:51.531 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:28:55.378 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:29:06.764 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:29:10.656 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:29:22.072 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:29:25.924 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:29:37.393 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:29:41.225 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:29:52.776 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:29:56.431 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:30:08.096 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:30:11.712 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:30:23.440 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:30:26.919 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-06-17T14:30:27.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:30:30.288 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:30:36.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:30:38.692 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:30:39.376 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:30:45.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:30:48.432 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:30:54.028 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:30:54.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:30:57.488 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:31:03.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:31:06.544 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:31:09.362 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:31:12.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:31:15.604 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:31:21.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:31:24.632 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:31:24.688 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:31:30.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:31:39.940 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:31:49.104 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:31:55.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:31:55.170 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:31:58.164 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-06-17T14:32:04.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:32:04.911 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-17T14:32:04.912 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-17T14:32:10.442 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:32:25.676 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:32:30.297 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-06-17T14:32:30.298 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-06-17T14:32:30.322 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-06-17T14:32:30.322 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-06-17T14:32:30.382 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-06-17T14:32:30.382 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-06-17T14:32:30.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-06-17T14:32:30.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-06-17T14:32:30.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-06-17T14:32:30.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-06-17T14:32:30.744 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-06-17T14:32:30.803 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-06-17T14:32:30.803 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-06-17T14:32:30.803 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-17T14:32:30.804 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-06-17T14:32:30.805 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-17T14:32:30.805 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-17T14:32:30.805 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-17T14:32:30.805 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-06-17T14:32:30.807 DEBUG:teuthology.parallel:result is None 2023-06-17T14:32:40.988 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:32:56.259 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:33:11.528 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:33:26.830 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:33:42.080 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:33:57.334 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:34:12.600 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:34:27.805 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:34:43.016 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:34:58.196 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-17T14:34:58.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:01.456 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:07.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:10.516 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:16.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:19.600 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:25.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:28.656 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:34.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:37.716 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:43.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:35:46.800 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:35:52.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:03.056 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:36:09.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:12.112 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:36:18.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:21.200 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-17T14:36:27.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:27.443 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-17T14:36:27.444 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-17T14:36:47.849 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-06-17T14:36:47.850 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-06-17T14:36:47.874 INFO:teuthology.orchestra.run.smithi139.stdout:smithi193 2023-06-17T14:36:47.875 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi193 /etc/hosts 2023-06-17T14:36:47.935 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-17T14:36:47.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-17T14:36:48.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi193/smithi139/g' /etc/hosts 2023-06-17T14:36:48.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.193/172.21.15.139/g' /etc/hosts 2023-06-17T14:36:48.209 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi193/smithi139/g' /etc/hostname 2023-06-17T14:36:48.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-17T14:36:48.348 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-17T14:36:48.406 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-06-17T14:36:48.407 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-06-17T14:36:48.407 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-06-17T14:36:48.407 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-06-17T14:36:48.408 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-06-17T14:36:48.408 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-06-17T14:36:48.408 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-17T14:36:48.409 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-06-17T14:36:48.409 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-17T14:36:48.409 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-06-17T14:36:48.409 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-17T14:36:48.410 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-17T14:36:48.410 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-17T14:36:48.411 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-06-17T14:36:48.411 DEBUG:teuthology.parallel:result is None 2023-06-17T14:36:48.581 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-06-17T14:36:48.582 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-17T14:36:48.605 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-06-17T14:36:48.605 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-17T14:36:48.631 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-06-17T14:36:48.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-06-17T14:36:48.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:48.698 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-06-17T14:36:48.771 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-06-17T14:36:48.828 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-06-17T14:36:48.829 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-17T14:36:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-06-17T14:36:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-06-17T14:36:48.886 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-17T14:36:48.887 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-06-17T14:36:48.888 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-17T14:36:48.888 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-17T14:36:48.888 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-17T14:36:48.889 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-17T14:36:48.913 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-06-17T14:36:48.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-06-17T14:36:48.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-17T14:36:48.983 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-06-17T14:36:49.119 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-06-17T14:36:49.179 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-06-17T14:36:49.179 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-06-17T14:36:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-06-17T14:36:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-06-17T14:36:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-06-17T14:36:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-06-17T14:36:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-17T14:36:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-17T14:36:49.241 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-06-17T14:36:49.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:36:49.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:36:49.380 INFO:teuthology.dispatcher.supervisor:Running job 7306597 2023-06-17T14:36:49.381 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7306597 --name teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7306597/orig.config.yaml 2023-06-17T14:36:49.384 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7306597 2023-06-17T14:36:49.385 INFO:teuthology.dispatcher.supervisor:Job PID: 14054 2023-06-17T14:36:49.385 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-17T14:38:49.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:38:49.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:40:49.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:40:49.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:42:49.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:42:49.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:44:50.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:44:50.215 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:46:50.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:46:50.415 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:48:50.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:48:50.607 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:50:50.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:50:50.810 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:52:50.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:52:50.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:54:51.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-17T14:54:51.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-17T14:54:51.230 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-17T14:54:51.358 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-17T14:54:51.358 INFO:teuthology.nuke:Checking targets against current locks 2023-06-17T14:54:51.408 DEBUG:teuthology.nuke:shortname: smithi139 2023-06-17T14:54:51.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-17T14:54:51.432 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7306597', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-17 14:24:56.340791', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCe0mZNKerxINE3YBPl7bFQlzYuDWAG+8o8KK7W7SoQ9OiJaXmufJ5hLNWyENrZaBvzBTOzgtR+4dGp9nwWqmKMEcTsJTddp38tk5eIZ+/VhnqjhZCtjyMQy1X0NBUdLHQTAdIehV+yD3Wa88q45zB0faDXwZPo78VBJTFi28RD3XgCFYjalDU4k04gfsypSJrHwLW0mlRbGEMiRWtyOD30FfWXKPk2/wYeiHao4ROwT06UQhlGejFcqkNo54GWb2IXCYc3syXr3tbzdnDr7WK5IZQgoFo4+E6iORqt2AuOpF662eXNIEzn0l7jMGREB3FJ+uha9711SCJPnRzyltxy456A4W+8/8roFTNFUrhjz1vXmg49PULCNYERk/NXsto9wLBGNAvA+EnbaQjHambMadpC1Mi0g+zzOzMf70hI1wIDFaA8M2WPEcnsfAOfqJ4ZdkOG8QJ1hTioYpxh0q5lV4SVPl8NKpMlfRQVBDpQbXiHUkMX/pNGOpcMoAFlLus='} 2023-06-17T14:54:51.437 DEBUG:teuthology.nuke:shortname: smithi191 2023-06-17T14:54:51.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-17T14:54:51.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-06-17_14:23:10-upgrade:pacific-x-reef-distro-default-smithi/7306597', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-17 14:24:56.342294', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyIuVqoZn9+AgomnXoMnyFq0unBgyPfQ9c/AO4NvFp5j3cjOPcCrOdsyy0Obe9iPzLDmpajhLCwS7zuBnjQ7MUYOYQ99tCD6r+aG9VDsFF//ZqGBZ3od+8uDJ+Cs9tPI2xplF4xpwZkeFiIzNR3r37XaTKb4ZP2wbdgn9a8X/io8+aQ8nU2WbvXg4lDMiXGX3giFUg7OyQpGamhcjfLsfFNsD03gY3AtQCm1zfZVQ9lwpuKhn0ca/GbOnPFYoj6k6LJv5eYtRXP3M/x7jPedI3teaJdGsOaKgL5YE2reeSELgUO9HZysRDDC5lqt4FjF/QP47p+ADo/R/+oR3ZVffKg8zEpv4U1XBVH1J34CPL4F6TPQwb8mDsPW6ObLyDU4G14LypxjMNq9VPiJNWfntfDmQmxmQuQ8XAJpHv7KvStmcQHqHWUKoRNIsGNd+LcgBPyKI4GY7U6wRv2zFOnd2WiwbEBDOgIZPPuO6hB5Rfgu4MHWUkuvGLw7Ra8lOv6H8='} 2023-06-17T14:54:51.484 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-17T14:54:51.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-17T14:54:51.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:54:51.524 INFO:teuthology.orchestra.console:Power off smithi191 2023-06-17T14:54:51.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-17T14:54:51.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-17T14:54:51.634 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-17T14:54:51.665 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-06-17T14:54:51.787 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-06-17T14:54:51.812 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com