2023-06-29T17:21:05.919 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-29T17:21:05.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:21:05.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:21:06.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa42604d8b0>, signals=[15]) 2023-06-29T17:21:06.094 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-06-29T17:21:06.094 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T17:21:06.094 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-06-29T17:21:06.123 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-06-29T17:21:06.123 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T17:21:06.124 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-29T17:21:06.126 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-06-29T17:21:06.148 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-06-29T17:21:06.219 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T17:21:06.226 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T17:21:06.271 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T17:21:06.271 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 3} 2023-06-29T17:21:06.275 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T17:21:06.276 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 3} 2023-06-29T17:21:06.318 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2023-06-29T17:21:06.319 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:21:06.325 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream 2023-06-29T17:21:06.326 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:21:06.371 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T17:21:06.379 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T17:21:06.404 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-06-29T17:21:06.414 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-06-29T17:21:06.459 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:21:06.474 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:21:06.552 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-29T17:21:06.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T17:21:06.571 INFO:teuthology.orchestra.console:Power off smithi120 2023-06-29T17:21:06.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T17:21:06.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:06.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:10.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:10.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:14.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:14.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:14.935 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-29T17:21:14.943 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-06-29T17:21:15.037 INFO:teuthology.orchestra.console:Power on smithi192 2023-06-29T17:21:15.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T17:21:15.046 INFO:teuthology.orchestra.console:Power on smithi120 2023-06-29T17:21:15.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T17:21:15.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:15.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:19.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:19.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:23.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:23.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T17:21:23.421 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2023-06-29T17:21:23.427 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2023-06-29T17:21:23.524 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-06-29T17:21:23.524 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:21:23.528 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-06-29T17:21:23.528 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:21:38.596 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:21:38.598 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:21:53.748 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:21:53.749 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:22:08.828 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:22:08.830 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:22:23.899 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:22:23.901 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:22:38.980 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:22:38.981 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:22:54.060 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:22:54.061 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:23:09.152 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:23:09.153 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:23:24.248 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:23:24.249 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:23:39.331 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:23:39.332 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:23:54.409 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-29T17:23:54.505 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-06-29T17:23:54.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:23:54.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:13.040 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T17:24:13.041 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-29T17:24:19.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:19.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:22.128 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T17:24:22.129 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-29T17:24:28.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:28.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:31.184 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T17:24:31.185 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-29T17:24:37.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:37.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:40.244 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T17:24:40.272 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-29T17:24:46.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:46.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:49.328 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-29T17:24:49.329 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-29T17:24:55.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:24:55.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:25:55.392 WARNING:teuthology.provision.fog.smithi192:timed out 2023-06-29T17:25:55.394 WARNING:teuthology.provision.fog.smithi120:timed out 2023-06-29T17:26:01.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:26:01.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:26:01.597 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T17:26:01.598 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T17:26:01.666 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T17:26:01.667 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T17:26:01.821 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-06-29T17:26:01.821 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-06-29T17:26:01.840 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2023-06-29T17:26:01.840 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2023-06-29T17:26:01.898 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-06-29T17:26:01.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-06-29T17:26:01.910 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-06-29T17:26:01.910 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-06-29T17:26:01.928 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-06-29T17:26:01.929 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-06-29T17:26:01.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2023-06-29T17:26:01.987 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-06-29T17:26:01.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-06-29T17:26:02.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-06-29T17:26:02.082 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-06-29T17:26:02.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2023-06-29T17:26:02.113 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-06-29T17:26:02.151 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-06-29T17:26:02.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-06-29T17:26:02.218 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-06-29T17:26:02.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-06-29T17:26:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-06-29T17:26:02.276 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8" 2023-06-29T17:26:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-06-29T17:26:02.277 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-06-29T17:26:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8" 2023-06-29T17:26:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-06-29T17:26:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T17:26:02.278 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-06-29T17:26:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T17:26:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-06-29T17:26:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T17:26:02.279 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T17:26:02.280 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T17:26:02.280 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-06-29T17:26:02.282 DEBUG:teuthology.parallel:result is None 2023-06-29T17:26:02.313 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-06-29T17:26:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T17:26:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T17:26:02.373 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T17:26:02.373 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-06-29T17:26:02.373 DEBUG:teuthology.parallel:result is None 2023-06-29T17:26:02.552 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-06-29T17:26:02.553 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T17:26:02.576 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-06-29T17:26:02.577 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T17:26:02.594 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-06-29T17:26:02.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-06-29T17:26:02.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:26:02.659 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-06-29T17:26:02.725 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-06-29T17:26:02.782 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-06-29T17:26:02.783 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-06-29T17:26:02.840 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-06-29T17:26:02.840 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8" 2023-06-29T17:26:02.840 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-06-29T17:26:02.840 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-06-29T17:26:02.841 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8" 2023-06-29T17:26:02.841 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-06-29T17:26:02.841 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T17:26:02.841 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-06-29T17:26:02.841 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T17:26:02.842 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-06-29T17:26:02.842 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T17:26:02.842 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T17:26:02.842 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T17:26:02.842 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-06-29T17:26:02.868 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-06-29T17:26:02.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-29T17:26:02.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T17:26:02.935 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-29T17:26:03.002 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-06-29T17:26:03.059 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-06-29T17:26:03.060 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-29T17:26:03.117 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-06-29T17:26:03.117 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-06-29T17:26:03.117 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T17:26:03.118 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-06-29T17:26:03.119 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T17:26:03.119 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T17:26:03.119 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T17:26:03.119 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-29T17:26:03.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:26:03.144 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:26:03.259 INFO:teuthology.dispatcher.supervisor:Running job 7321726 2023-06-29T17:26:03.259 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321726 --name yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321726/orig.config.yaml 2023-06-29T17:26:03.262 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321726 2023-06-29T17:26:03.263 INFO:teuthology.dispatcher.supervisor:Job PID: 7696 2023-06-29T17:26:03.263 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-29T17:28:03.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:28:03.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:30:03.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:30:03.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:32:03.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:32:03.703 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:34:03.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:34:03.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:36:04.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:36:04.050 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:38:04.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:38:04.229 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:40:04.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:40:04.411 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:42:04.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:42:04.583 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:44:04.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:44:04.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:46:04.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:46:04.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:48:05.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:48:05.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:50:05.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:50:05.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:52:05.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:52:05.400 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:54:05.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:54:05.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:56:05.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:56:05.752 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T17:58:05.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T17:58:05.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T18:00:06.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T18:00:06.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T18:02:06.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T18:02:06.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T18:02:06.350 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-29T18:02:06.470 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-29T18:02:06.470 INFO:teuthology.nuke:Checking targets against current locks 2023-06-29T18:02:06.519 DEBUG:teuthology.nuke:shortname: smithi120 2023-06-29T18:02:06.519 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T18:02:06.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 17:21:05.027621', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3dTYdA0/KngjpKhQTMJGWWxCBz/odvCOnYNWBpb97cqsQaed/X/LdkWb1qiwCwKrdkrrDlcIey7WrMFRVJ1yM='} 2023-06-29T18:02:06.542 DEBUG:teuthology.nuke:shortname: smithi192 2023-06-29T18:02:06.542 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T18:02:06.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 17:21:05.029406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCSm7qf0lBa2eVQuetvf6XI/7ez4Fu2USIl17xvWgTh9atILavhV70hZs6MzRURwALEWJG+muixXVxNPXZ5pNCDIinZhSHaXaJQJaD/TmssMBTOL24Bdj73NMLod5GFZKBPmPNqXNy66tWY0XRRR357k/NuybyHOtr5exuR5y6S9L5+sgZeGIEan/MfbusD+kQefuZEGq75ImMnBYep0ee/NjCMzIN5ZoUIOKZxRL/lIxgfJaWDrj2cDpDSJXEG8ITNqhvvUOipkxWn/kfJ8wfnRZbE9gyDHVl+ipfFWyE4aJ6snXz+5Q8jGkOLY5XHcauNoAA9h/J686XT3HSa7ROLaZE3rDlduNVNHAqVRWLwmJEf+kAa1meiNcRHkrITQYi7xicPyaDIY5JIh3GBnPNdi5lKzPleGbu7TAgzrBS2sIgZY1sBmP1ZxKrqYI2fco6baFTRKCmzICgHJwsqPtIGc4K/GJ4Ykn4tbQk3HemorJT0vrNbftwYdC+dn459u5k='} 2023-06-29T18:02:06.589 INFO:teuthology.orchestra.console:Power off smithi120 2023-06-29T18:02:06.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T18:02:06.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T18:02:06.626 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-29T18:02:06.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T18:02:06.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T18:02:06.737 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-06-29T18:02:06.766 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-29T18:02:06.891 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-06-29T18:02:06.915 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com