2023-07-04T06:21:19.002 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T06:21:19.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:21:19.003 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:21:19.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd5aefb0700>, signals=[15]) 2023-07-04T06:21:19.157 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-04T06:21:19.157 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T06:21:19.157 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-04T06:21:19.180 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-07-04T06:21:19.180 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T06:21:19.180 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-04T06:21:19.181 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-04T06:21:19.205 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-07-04T06:21:19.245 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T06:21:19.263 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T06:21:19.282 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T06:21:19.283 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-07-04T06:21:19.311 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T06:21:19.311 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 3} 2023-07-04T06:21:19.331 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-07-04T06:21:19.331 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:21:19.358 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2023-07-04T06:21:19.358 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:21:19.373 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T06:21:19.399 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T06:21:19.407 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-04T06:21:19.431 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-07-04T06:21:19.464 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:21:19.479 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:21:19.558 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-04T06:21:19.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T06:21:19.571 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-04T06:21:19.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T06:21:19.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:19.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:23.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:23.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:27.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:27.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:27.937 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-04T06:21:28.038 INFO:teuthology.orchestra.console:Power on smithi145 2023-07-04T06:21:28.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T06:21:28.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:31.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:32.042 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-04T06:21:32.079 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:32.144 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-04T06:21:32.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T06:21:32.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:36.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:36.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T06:21:36.410 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-07-04T06:21:36.411 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-04T06:21:36.512 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-07-04T06:21:36.512 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:21:36.514 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-04T06:21:36.514 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:21:51.696 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:21:51.697 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:22:06.882 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:22:06.883 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:22:22.052 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:22:22.054 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:22:37.221 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:22:37.223 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:22:52.381 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:22:52.382 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:23:07.569 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:23:07.570 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:23:22.751 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:23:22.752 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:23:37.965 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:23:37.966 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:23:53.171 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:23:53.173 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:24:08.378 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:24:08.379 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:24:23.563 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:24:23.564 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:24:38.787 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:24:38.788 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:24:53.949 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:24:53.951 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:25:09.100 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:25:09.101 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:25:24.614 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:25:24.620 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:25:39.761 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:25:39.764 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:25:54.908 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:25:54.909 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:26:10.029 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:26:10.030 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:26:25.191 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:26:25.199 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:26:40.340 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:26:40.341 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:26:55.473 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:26:55.475 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:27:10.601 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:27:10.602 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:27:25.742 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-04T06:27:25.743 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:27:25.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:27:40.868 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:27:44.368 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:27:50.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:27:53.424 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:27:55.982 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-04T06:27:56.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:27:59.152 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:27:59.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:02.480 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:28:05.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:08.208 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:08.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:11.536 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:28:14.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:17.264 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:17.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:20.592 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:28:23.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:26.320 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:26.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:29.648 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-04T06:28:32.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:35.376 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:35.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:41.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:44.432 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:50.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:28:53.488 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:28:59.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:29:17.808 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:29:23.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:29:26.864 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-04T06:29:32.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:29:34.277 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T06:29:34.278 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T06:29:35.652 WARNING:teuthology.provision.fog.smithi090:timed out 2023-07-04T06:29:41.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:29:42.019 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T06:29:42.020 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T06:29:42.339 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-07-04T06:29:42.339 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-07-04T06:29:42.358 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-07-04T06:29:42.359 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-07-04T06:29:42.418 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-07-04T06:29:42.418 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-04T06:29:42.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-07-04T06:29:42.593 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-07-04T06:29:42.661 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-07-04T06:29:42.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-04T06:29:42.796 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-04T06:29:42.854 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-04T06:29:42.854 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-04T06:29:42.854 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-04T06:29:42.854 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-04T06:29:42.855 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T06:29:42.856 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T06:29:42.856 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T06:29:42.856 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-07-04T06:29:42.858 DEBUG:teuthology.parallel:result is None 2023-07-04T06:29:59.844 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-07-04T06:29:59.845 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-07-04T06:29:59.869 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-07-04T06:29:59.869 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-07-04T06:29:59.929 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-07-04T06:29:59.930 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-04T06:30:00.069 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-07-04T06:30:00.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-07-04T06:30:00.170 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-07-04T06:30:00.239 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-04T06:30:00.307 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-04T06:30:00.366 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-07-04T06:30:00.366 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-04T06:30:00.367 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T06:30:00.368 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-07-04T06:30:00.368 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T06:30:00.368 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T06:30:00.368 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T06:30:00.368 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-07-04T06:30:00.369 DEBUG:teuthology.parallel:result is None 2023-07-04T06:30:00.521 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-07-04T06:30:00.522 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T06:30:00.552 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-07-04T06:30:00.553 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T06:30:00.578 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-07-04T06:30:00.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-04T06:30:00.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:30:00.647 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-04T06:30:00.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-04T06:30:00.783 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-07-04T06:30:00.841 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-07-04T06:30:00.842 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-04T06:30:00.900 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-04T06:30:00.901 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T06:30:00.902 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T06:30:00.903 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-04T06:30:00.927 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-07-04T06:30:00.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-04T06:30:00.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T06:30:00.994 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-04T06:30:01.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-04T06:30:01.021 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-04T06:30:01.079 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-04T06:30:01.079 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-04T06:30:01.137 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-07-04T06:30:01.137 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-07-04T06:30:01.137 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-07-04T06:30:01.137 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T06:30:01.138 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T06:30:01.139 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T06:30:01.139 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-04T06:30:01.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:30:01.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:30:01.245 INFO:teuthology.dispatcher.supervisor:Running job 7325961 2023-07-04T06:30:01.245 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi/7325961 --name yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi --description crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi/7325961/orig.config.yaml 2023-07-04T06:30:01.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi/7325961 2023-07-04T06:30:01.249 INFO:teuthology.dispatcher.supervisor:Job PID: 22288 2023-07-04T06:30:01.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-04T06:32:01.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:32:01.351 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:34:01.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:34:01.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:36:01.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:36:01.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:38:01.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:38:01.924 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:40:02.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:40:02.096 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:42:02.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:42:02.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:44:02.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:44:02.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:46:02.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:46:02.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:48:02.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:48:02.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:50:02.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:50:02.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:52:03.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:52:03.040 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:54:03.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:54:03.119 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:56:03.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:56:03.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T06:58:03.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T06:58:03.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T07:00:03.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T07:00:03.597 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T07:02:03.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T07:02:03.754 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T07:04:03.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T07:04:03.870 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T07:06:04.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T07:06:04.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T07:06:04.090 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-04T07:06:04.182 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-04T07:06:04.182 INFO:teuthology.nuke:Checking targets against current locks 2023-07-04T07:06:04.231 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-04T07:06:04.232 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T07:06:04.244 DEBUG:teuthology.nuke:shortname: smithi145 2023-07-04T07:06:04.244 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T07:06:04.253 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi/7325961', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 06:21:18.240297', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2/kgRgEKwHCT/RuQvhu/J/P1Gk51xIUUwSI/1Kc9AV9PAEY+2x65HVuOkeJwDKApRAL5sqaIxPlhzrIC/vzOU='} 2023-07-04T07:06:04.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-07-04_06:20:13-crimson-rados-wip-yingxin-multi-core-enabled-distro-default-smithi/7325961', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 06:21:18.242716', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqEOj98zKoLK5R+b3Yv8f31FDqHjKsj9N2SDSptfNhyKpBqO340OqZBW6/g2C7tJwKfHbkI0fwtVPiubKCnL2l2gGTq/fG0VMKLQMjzr5SUg4inSP96y9ZuR6kS8yFZJ9bZqV6j1+hECvCEBTKcM21CsTS02+CBZHLu9u3qFJUbVrlqupVe9ql+FEqB1uN6Iv/AvpzB2NngjO82coIxnBp+HUppOf61UupwwpZTsVPqkeFE/3RCiAWUPZLg0cq9B8reTIqgppB+vabex4zf+bQs446f8Q2NJeGrVbI1+Dc16aKLjJdtob2ApIElrNhTHba89qaZeVQR6daKDnnBtRSw1i6Ps+Sc3dqBnMgrZ+jGtSv9qiJSJOKuIIZXk0pVcJ7oJcR3ORU/kfwc9jyhTuPyQ9nKAE4IGYWOqnymjMoKlaicpFoNvN6jNph0saoSD1si+vXaDBak4OVCNGMClROMRGAITMkVKco2KEWSvs/L4WfDe/rlSUJpIrYUG/Y/e8='} 2023-07-04T07:06:04.303 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-04T07:06:04.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T07:06:04.317 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-04T07:06:04.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T07:06:04.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T07:06:04.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T07:06:04.447 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-04T07:06:04.457 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-04T07:06:04.605 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-07-04T07:06:04.613 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com