2023-07-08T06:31:41.529 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T06:31:41.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:31:41.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:31:41.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd81968e8b0>, signals=[15]) 2023-07-08T06:31:41.680 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-08T06:31:41.681 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:41.681 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-08T06:31:41.703 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-08T06:31:41.704 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:41.705 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-08T06:31:41.706 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-08T06:31:41.728 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-08T06:31:41.777 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T06:31:41.789 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T06:31:41.817 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T06:31:41.817 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 3} 2023-07-08T06:31:41.832 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T06:31:41.832 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-07-08T06:31:41.862 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2023-07-08T06:31:41.862 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:31:41.872 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-07-08T06:31:41.872 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:31:41.916 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:41.918 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:41.953 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-08T06:31:41.956 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-08T06:31:42.023 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:31:42.026 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:31:42.095 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-08T06:31:42.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:42.110 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-08T06:31:42.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:42.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:42.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:42.242 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-08T06:31:42.254 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-08T06:31:42.343 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-08T06:31:42.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:31:42.355 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-08T06:31:42.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:31:42.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:42.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:46.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:46.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:50.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:50.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:50.715 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-08T06:31:50.724 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-08T06:31:50.817 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-08T06:31:50.818 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:31:50.825 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-08T06:31:50.825 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:32:05.958 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:32:05.962 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:32:21.248 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:32:21.249 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:32:36.472 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:32:36.485 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:32:51.703 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:32:51.726 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:33:06.974 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:33:06.976 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:33:22.250 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:33:22.251 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:33:37.561 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:33:37.563 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:33:53.002 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:33:53.003 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:34:08.559 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:34:08.560 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:34:24.368 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:34:24.405 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:34:43.099 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:34:43.100 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:34:58.592 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:34:58.644 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:35:15.184 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:35:15.347 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:35:31.708 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:35:31.721 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:35:51.168 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:35:51.524 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:36:07.608 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:36:08.349 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:36:23.012 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:36:25.026 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:36:38.473 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:36:41.390 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:36:54.793 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:36:56.756 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:37:11.296 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:37:12.111 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:37:27.900 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:37:28.164 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:37:44.655 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:37:44.731 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:38:00.604 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:38:00.642 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:38:16.578 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-08T06:38:16.709 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:38:17.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:20.432 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:38:26.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:29.520 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:38:32.416 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:38:35.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:38.576 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:38:44.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:47.632 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:38:48.027 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:38:53.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:56.688 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:39:02.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:39:03.378 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:39:05.744 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:39:11.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:39:14.832 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-08T06:39:18.768 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:39:20.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:39:34.184 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:39:49.508 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:40:04.844 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:40:20.165 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:40:20.837 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-08T06:40:26.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:40:27.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:40:27.061 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:40:27.354 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-08T06:40:27.354 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-08T06:40:27.374 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-08T06:40:27.374 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-08T06:40:27.433 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-08T06:40:27.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-08T06:40:27.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-08T06:40:27.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-08T06:40:27.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-08T06:40:27.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-08T06:40:27.790 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-08T06:40:27.848 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:40:27.849 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-08T06:40:27.850 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:40:27.850 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:40:27.850 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:40:27.850 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:40:27.850 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:40:27.851 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-08T06:40:27.852 DEBUG:teuthology.parallel:result is None 2023-07-08T06:40:35.507 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:40:50.816 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:41:06.096 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:41:21.370 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:41:36.632 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:41:51.884 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:42:07.144 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:42:22.368 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:42:37.598 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:42:52.800 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:43:08.009 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:43:23.208 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:43:38.403 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:43:53.568 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:44:08.720 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:44:23.888 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:44:39.040 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:44:54.196 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:45:09.324 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:45:24.462 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:45:39.576 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:45:54.718 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-08T06:45:54.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:45:57.872 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:03.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:06.964 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:12.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:16.054 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:22.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:25.136 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:31.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:34.225 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:40.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:43.284 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:49.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:46:52.376 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:46:58.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:47:01.460 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:47:07.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:47:25.808 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:47:31.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:47:34.864 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-08T06:47:40.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:47:43.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:47:43.790 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:48:09.310 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-08T06:48:09.311 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-08T06:48:09.336 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-08T06:48:09.336 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-08T06:48:09.397 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-08T06:48:09.398 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-08T06:48:09.525 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-08T06:48:09.557 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-08T06:48:09.625 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-08T06:48:09.695 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-08T06:48:09.764 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-08T06:48:09.824 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-08T06:48:09.824 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-08T06:48:09.824 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:48:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:48:09.826 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:48:09.826 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:48:09.826 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:48:09.826 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-08T06:48:09.827 DEBUG:teuthology.parallel:result is None 2023-07-08T06:48:10.005 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-08T06:48:10.006 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:48:10.026 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-08T06:48:10.026 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:48:10.061 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:48:10.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-08T06:48:10.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:48:10.169 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-08T06:48:10.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-08T06:48:10.307 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-08T06:48:10.366 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-08T06:48:10.366 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-08T06:48:10.425 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-08T06:48:10.426 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-07-08T06:48:10.426 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-08T06:48:10.426 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:48:10.426 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:48:10.427 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:48:10.428 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:48:10.428 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-08T06:48:10.451 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:48:10.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-08T06:48:10.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:48:10.521 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-08T06:48:10.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-08T06:48:10.596 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-08T06:48:10.654 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-08T06:48:10.655 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-08T06:48:10.712 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:48:10.713 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-08T06:48:10.714 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:48:10.714 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:48:10.714 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:48:10.714 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:48:10.714 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:48:10.715 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-08T06:48:10.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:48:10.733 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:48:10.822 INFO:teuthology.dispatcher.supervisor:Running job 7328930 2023-07-08T06:48:10.823 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328930 --name adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi --description orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328930/orig.config.yaml 2023-07-08T06:48:10.827 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328930 2023-07-08T06:48:10.828 INFO:teuthology.dispatcher.supervisor:Job PID: 27795 2023-07-08T06:48:10.828 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T06:50:10.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:50:10.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:52:11.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:52:11.152 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:54:11.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:54:11.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:56:11.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:56:11.629 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:58:11.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:58:11.813 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:00:11.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:00:11.979 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:02:12.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:02:12.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:02:12.232 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T07:02:12.336 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T07:02:12.336 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T07:02:12.391 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-08T07:02:12.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:02:12.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:40.795497', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE7f+cmj1GzFrw0EHb5+2BAIqPT9SUfGAmqny/3ys4E9erkvyOVjvejAm6kKjNH1M7eXutu5BktImLCMNsm5lDYiwnGpCgagSXj0CMGH5nyOcWuneiOoESLjwG3M9ViEOyrnpB4cKqPIhPxyH3GDhGpYuDKGR3E8dlc3D9a1kZJB96duM6jbDcPD9v1Ny9DOOlSlJyej7ktViUJxnB7WINHsgGvBJf+ic4h0S9HkezKb/AiEEZQ6nXW7sJuwPYXhE68rtMMCX9uq4FjqGPkLSJW5wHrPUhmi2nolqJoBtCVbqaqWkck++DR6LU4ouF/cti2HBRfwpCgZowTFHtDMTlYMCLioVcNeUdN2T2wMwxTC0R3AXtZ4i3Okw+kVxQ1upS30+DzqzgVgjxjrbOdU/n5FKPbHap+IAAY+qoUbNueqQzUoROC/sEIKWcTHBfQFZHi9396nblzuS5tEh+Cd1eTc5qhXiQtNApiU9ym1jUK0fiX4+7bB8Wu5pbl+4UWg8='} 2023-07-08T07:02:12.417 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-08T07:02:12.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:02:12.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:40.797172', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDY25zdPL7/8NhGovDmJTopYDg2OUIUIxSuz0NTF0Q1sqjRia3EiybU9UWHEYbRo3jR0+OEcVOzq/rMArjDiQen10JphS3dt4bZ0WEdzz+O/Y07yhVD4mRVVhNnDbruho4TDi1AC7U2bhiB1xbd/F7z1hb5ohv1LiMZepQWei03hDmrfypzzPQeY0YpVeQJQL/NHdpD0KVBugIACFInBy5tluxHOvd7vbFvmJpRnr7gi1ITSuf9rbfZk+ozUhq9/VWxK7aMPZkYDZQJ7QqiKo+MvLNUssTp8bI7AzL6kVzpTJGOE+k46JMF/uq6e2lbSZssRFnZrjO5hesCQrV/krh6QGbFHG+v68zNIQmcTJwuJPB8zLaCgYd74ezC+8NNXBPZibGcdVbcZj+Q/cVGOrYXUaMJtxWN0ubq9ix0eV0folyTCx4bLXJFY9/Wj6nlLZWIOKQQB0QbZ8/+jRiSUrbInwAoyYy9PuKDxu1hu9ZaAvYtLmeNkv/3kw9RPKk+omc='} 2023-07-08T07:02:12.468 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-08T07:02:12.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:02:12.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:02:12.518 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-08T07:02:12.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:02:12.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:02:12.631 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-08T07:02:12.668 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-08T07:02:12.788 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-07-08T07:02:12.822 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com