2023-07-12T13:21:23.709 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T13:21:23.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:21:23.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:21:23.865 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7754fd48b0>, signals=[15]) 2023-07-12T13:21:23.867 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-12T13:21:23.868 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T13:21:23.868 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-12T13:21:23.895 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-07-12T13:21:23.895 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T13:21:23.896 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-07-12T13:21:23.898 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-12T13:21:23.918 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-07-12T13:21:23.979 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-12T13:21:23.992 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-12T13:21:24.036 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-07-12T13:21:24.036 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-07-12T13:21:24.044 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_8.stream (ID 3) 2023-07-12T13:21:24.044 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 3} 2023-07-12T13:21:24.085 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-07-12T13:21:24.086 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:21:24.097 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2023-07-12T13:21:24.097 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:21:24.156 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T13:21:24.159 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T13:21:24.200 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-12T13:21:24.202 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-07-12T13:21:24.263 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:21:24.265 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:21:24.379 INFO:teuthology.orchestra.console:Power off smithi143 2023-07-12T13:21:24.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T13:21:24.396 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-12T13:21:24.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T13:21:24.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:24.418 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:28.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:28.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:32.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:32.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:32.757 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-07-12T13:21:32.766 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-12T13:21:32.859 INFO:teuthology.orchestra.console:Power on smithi143 2023-07-12T13:21:32.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T13:21:32.869 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-12T13:21:32.870 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T13:21:32.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:32.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:36.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:36.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:37.130 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-12T13:21:37.231 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-12T13:21:37.232 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:21:41.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:21:41.230 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2023-07-12T13:21:41.331 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-07-12T13:21:41.331 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:21:52.320 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:21:56.416 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:22:07.409 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:22:11.496 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:22:22.492 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:22:26.584 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:22:37.580 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:22:41.670 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:22:52.664 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:22:56.744 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:23:07.736 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:23:11.816 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:23:22.816 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:23:26.893 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:23:37.888 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:23:41.960 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:23:52.964 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:23:57.027 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:24:08.031 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:24:12.092 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-12T13:24:12.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:15.220 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:24:21.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:23.096 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:24:24.304 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:24:30.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:33.392 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:24:38.156 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:24:39.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:42.448 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:24:48.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:51.504 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:24:53.215 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-12T13:24:53.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:24:56.336 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:24:57.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:00.560 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:25:02.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:05.396 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:06.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:09.616 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-12T13:25:11.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:14.480 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:15.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:20.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:23.536 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:29.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:32.624 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:38.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:41.680 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:47.238 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T13:25:47.239 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T13:25:47.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:25:50.740 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-12T13:25:56.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:26:12.604 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-07-12T13:26:12.604 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-07-12T13:26:12.628 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-07-12T13:26:12.629 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-07-12T13:26:12.689 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-07-12T13:26:12.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-07-12T13:26:12.815 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-07-12T13:26:12.846 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-07-12T13:26:12.915 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-07-12T13:26:12.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-07-12T13:26:13.050 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-07-12T13:26:13.108 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-07-12T13:26:13.109 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T13:26:13.110 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T13:26:13.111 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-07-12T13:26:13.112 DEBUG:teuthology.parallel:result is None 2023-07-12T13:26:56.769 WARNING:teuthology.provision.fog.smithi090:timed out 2023-07-12T13:27:02.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:27:03.077 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T13:27:03.077 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T13:27:03.401 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-07-12T13:27:03.401 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-07-12T13:27:03.420 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-07-12T13:27:03.421 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-07-12T13:27:03.479 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-07-12T13:27:03.479 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-12T13:27:03.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-07-12T13:27:03.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-07-12T13:27:03.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-07-12T13:27:03.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-12T13:27:03.844 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-12T13:27:03.902 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T13:27:03.903 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T13:27:03.904 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-07-12T13:27:03.904 DEBUG:teuthology.parallel:result is None 2023-07-12T13:27:04.063 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-07-12T13:27:04.064 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T13:27:04.096 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-07-12T13:27:04.097 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T13:27:04.122 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-07-12T13:27:04.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-12T13:27:04.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:27:04.187 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-12T13:27:04.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-12T13:27:04.254 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-07-12T13:27:04.312 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-07-12T13:27:04.312 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-12T13:27:04.370 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-12T13:27:04.370 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-12T13:27:04.371 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-12T13:27:04.371 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-12T13:27:04.371 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-12T13:27:04.371 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-12T13:27:04.372 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T13:27:04.372 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-12T13:27:04.372 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T13:27:04.372 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-12T13:27:04.372 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T13:27:04.373 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T13:27:04.373 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T13:27:04.374 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-12T13:27:04.395 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-07-12T13:27:04.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-07-12T13:27:04.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T13:27:04.466 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-07-12T13:27:04.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-07-12T13:27:04.600 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-07-12T13:27:04.660 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-07-12T13:27:04.660 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-07-12T13:27:04.719 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-07-12T13:27:04.719 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-07-12T13:27:04.719 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-07-12T13:27:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T13:27:04.721 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-07-12T13:27:04.721 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T13:27:04.721 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T13:27:04.721 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T13:27:04.721 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-07-12T13:27:04.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:27:04.746 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:27:04.849 INFO:teuthology.dispatcher.supervisor:Running job 7335151 2023-07-12T13:27:04.850 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335151 --name gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335151/orig.config.yaml 2023-07-12T13:27:04.853 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335151 2023-07-12T13:27:04.854 INFO:teuthology.dispatcher.supervisor:Job PID: 25474 2023-07-12T13:27:04.854 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T13:29:04.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:29:04.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:31:05.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:31:05.131 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:33:05.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:33:05.305 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:35:05.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:35:05.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:37:05.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:37:05.647 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:39:05.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:39:05.814 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:41:05.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:41:05.982 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:43:06.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:43:06.156 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:45:06.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:45:06.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:47:06.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:47:06.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:49:06.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T13:49:06.666 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T13:49:06.747 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T13:49:06.837 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T13:49:06.838 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T13:49:06.893 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-12T13:49:06.893 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T13:49:06.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335151', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 13:21:22.844486', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbzrS+fmyAQVOtkMmlILgKjpl+UCAOVyBCJ1Sx04SYPoo0kGds/K0yBCUr9QFti1rGDcmdUSYqhgH416zz4yMUAY292G0RVGJsY8Em74UiXz7BoB90XrrgRUDRTsWIvoJ48Y1x9RSMFR3MwamR4uK3hhaEFsLTLH05bvt6ORRS9NdvSiFmtm0DYTopme7kyZxTgC6dD55NARi86QQzHGSrPcDKMfMuVg+oQ7/uldzoWz4EDoii3brPMmaRK/zj3NNuBIw27LcxCmeWXPCwvg8ahRMK4J3h2/0TWKgWQ2nEALQWSIC1H1N0xHZolUUTgWulYZ1Nm51YCDvVHEtNS3sCQ3O67DC7HhqzVyPifFrZVP1KQVbiyGBB20t/bb2l/R/UkShlLF3irik+v4w8MA1aVJy6hB+Y3WA98YGajnDgvDH+FPGUNtU/FviEh2VyQMnfXj7TpaGNsu0VGUIp5rR18yTlWSbIiAIJzhQVudY5hrxNderCq0qNBgfAP5xuWRE='} 2023-07-12T13:49:06.924 DEBUG:teuthology.nuke:shortname: smithi143 2023-07-12T13:49:06.925 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T13:49:06.950 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-12_12:54:23-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335151', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 13:21:22.842128', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9O5zDQN8R8NGj1jrXAbGWDMoU/0qbaRBuA/34QJOzq6qUv91FJE6Mc3cq91yPhPm7y/p+FGJ6L4IRfuuuuU/WgAihxwdym2FCbBapnaSnpVDMAi9FYBZRESwVqnZNXwiN/vjfG/0sgUKfBo55SvncrVUefuwlulTCv21fmLO8e9H04FAy+nrzoJKE1REzTNAfuTR9rFtqLNaJGQghF6Mbeg5KBC4f5k0MezK8BKDjjS/DAVZm+4bKM2M5ldLNfAMcjYDqgOrd9+o9xoP0LvTIVHMtjXbmMfLJklODkoSJ4+36QNLEUIHv/HLHLjwo6uKOyPo63V2ybkpAzc5RZa5/j8AOE8paiLT4F/auK2e9kFG0MQmBmnJBbCV+BXckSISpSf11kZRCtdNHEaDQemkMlvtGtE2RxitKa870WrUlB3jPlcChEAR70AJk+nDhGH8X3i5pX+p5xlMOKLcOaD5+VTs5BliHiAG2kxoey0SA/QOxtn2jc/gMClTT5QF6qW8='} 2023-07-12T13:49:06.974 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-12T13:49:06.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T13:49:06.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:49:07.021 INFO:teuthology.orchestra.console:Power off smithi143 2023-07-12T13:49:07.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T13:49:07.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T13:49:07.130 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-12T13:49:07.163 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-07-12T13:49:07.287 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-07-12T13:49:07.312 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com