2023-06-22T15:01:26.318 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T15:01:26.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:01:26.320 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:01:51.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed5cd3a430>, signals=[15]) 2023-06-22T15:01:51.502 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-06-22T15:01:51.503 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T15:01:51.503 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-22T15:01:56.524 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-06-22T15:01:56.525 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T15:01:56.525 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-06-22T15:01:56.526 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-06-22T15:02:06.573 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-06-22T15:02:16.611 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-06-22T15:02:26.645 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-06-22T15:02:26.660 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2023-06-22T15:02:26.660 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 10} 2023-06-22T15:02:26.688 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10) 2023-06-22T15:02:26.688 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 10} 2023-06-22T15:02:26.712 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2023-06-22T15:02:26.713 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:02:26.732 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream 2023-06-22T15:02:26.732 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-22T15:02:26.759 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T15:02:26.779 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T15:02:26.795 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-06-22T15:02:26.812 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-06-22T15:02:26.841 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:02:26.863 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-22T15:02:32.658 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-22T15:02:32.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:02:32.676 INFO:teuthology.orchestra.console:Power off smithi159 2023-06-22T15:02:32.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:02:32.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:32.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:32.813 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-22T15:02:32.823 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-06-22T15:02:32.915 INFO:teuthology.orchestra.console:Power on smithi118 2023-06-22T15:02:32.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T15:02:32.925 INFO:teuthology.orchestra.console:Power on smithi159 2023-06-22T15:02:32.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T15:02:32.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:32.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:36.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:36.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:41.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:41.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:46.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:46.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:46.403 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-06-22T15:02:46.504 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-06-22T15:02:46.505 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:02:51.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:56.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:02:56.634 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-06-22T15:02:56.735 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-06-22T15:02:56.735 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-22T15:03:01.741 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:03:06.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:03:09.136 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:03:15.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:03:18.192 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:03:21.056 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:03:26.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:03:34.128 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:03:40.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:03:43.184 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:03:46.120 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:03:51.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:04:11.208 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:04:14.448 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:04:20.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:04:25.572 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:04:31.575 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:04:36.647 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:04:42.722 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:04:43.835 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:04:49.910 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:04:55.913 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:05:01.032 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:05:02.144 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:05:08.259 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-06-22T15:05:15.979 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:05:32.905 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-22T15:05:37.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:05:56.336 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:06:02.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:10.416 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:06:13.497 WARNING:teuthology.provision.fog.smithi159:timed out 2023-06-22T15:06:16.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:19.472 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:06:19.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:25.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:33.556 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:06:39.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:44.561 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:06:47.632 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:06:50.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:53.620 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-22T15:06:53.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:06:59.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:07:04.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T15:07:04.797 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T15:07:16.980 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:07:20.098 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-06-22T15:07:20.098 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-06-22T15:07:20.116 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-06-22T15:07:20.116 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-06-22T15:07:20.177 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-06-22T15:07:20.177 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-06-22T15:07:20.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-06-22T15:07:20.343 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-06-22T15:07:20.412 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-06-22T15:07:20.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-06-22T15:07:20.548 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-06-22T15:07:20.603 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-06-22T15:07:20.603 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2023-06-22T15:07:20.603 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-06-22T15:07:20.604 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-06-22T15:07:20.604 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2023-06-22T15:07:20.604 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2023-06-22T15:07:20.605 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T15:07:20.605 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-06-22T15:07:20.605 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2023-06-22T15:07:20.605 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T15:07:20.606 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-06-22T15:07:20.606 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T15:07:20.606 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T15:07:20.606 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T15:07:20.608 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-06-22T15:07:20.610 DEBUG:teuthology.parallel:result is None 2023-06-22T15:07:22.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:07:26.064 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-22T15:07:32.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:07:32.414 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T15:07:32.414 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T15:07:52.419 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-06-22T15:07:52.420 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-06-22T15:07:52.438 INFO:teuthology.orchestra.run.smithi118.stdout:smithi197 2023-06-22T15:07:52.438 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi197 /etc/hosts 2023-06-22T15:07:52.495 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2023-06-22T15:07:52.495 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-06-22T15:07:52.607 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi197/smithi118/g' /etc/hosts 2023-06-22T15:07:52.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.197/172.21.15.118/g' /etc/hosts 2023-06-22T15:07:52.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi197/smithi118/g' /etc/hostname 2023-06-22T15:07:52.775 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-06-22T15:07:52.841 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-06-22T15:07:52.896 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-06-22T15:07:52.896 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-06-22T15:07:52.896 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-06-22T15:07:52.897 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-06-22T15:07:52.897 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-06-22T15:07:52.897 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-06-22T15:07:52.897 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T15:07:52.897 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T15:07:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T15:07:52.899 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-06-22T15:07:52.899 DEBUG:teuthology.parallel:result is None 2023-06-22T15:07:58.068 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-06-22T15:07:58.069 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T15:08:03.095 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-06-22T15:08:03.095 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T15:08:08.129 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-06-22T15:08:08.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-22T15:08:08.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:08:08.215 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-06-22T15:08:08.407 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-06-22T15:08:08.462 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-06-22T15:08:08.462 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-06-22T15:08:08.520 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-06-22T15:08:08.520 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2023-06-22T15:08:08.520 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-06-22T15:08:08.520 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-06-22T15:08:08.521 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T15:08:08.522 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T15:08:08.522 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T15:08:08.522 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-22T15:08:13.553 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-06-22T15:08:13.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-22T15:08:13.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T15:08:18.644 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-06-22T15:08:18.819 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-06-22T15:08:18.874 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-06-22T15:08:18.874 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2023-06-22T15:08:18.929 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T15:08:18.930 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T15:08:18.931 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T15:08:18.931 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-06-22T15:08:23.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:08:23.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:08:29.075 INFO:teuthology.dispatcher.supervisor:Running job 7311731 2023-06-22T15:08:29.076 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311731 --name lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311731/orig.config.yaml 2023-06-22T15:08:29.080 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311731 2023-06-22T15:08:29.080 INFO:teuthology.dispatcher.supervisor:Job PID: 2787 2023-06-22T15:08:29.081 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T15:10:29.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:10:29.083 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:12:34.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:12:34.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:14:34.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:14:34.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:16:39.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:16:39.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:18:45.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:18:45.059 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:20:48.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:20:48.360 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:22:53.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:22:53.441 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:24:58.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:24:58.513 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:25:03.587 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T15:25:04.258 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T15:25:04.258 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T15:25:04.296 DEBUG:teuthology.nuke:shortname: smithi118 2023-06-22T15:25:04.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T15:25:04.327 DEBUG:teuthology.nuke:shortname: smithi159 2023-06-22T15:25:04.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T15:25:04.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311731', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 15:01:25.501292', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPR1XFInLqsGMGpdjfu7+cZGlAT3DL9SYdYxI2uqiiFGjUZIyxUUUvSojUcUUoGhZbfZAENdwtTW9Tb4W3l0Lvs='} 2023-06-22T15:25:04.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311731', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 15:01:25.502977', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCroRet3Jsa5lSin4M2mr0/AgDJWyt6U7X7n4HiZH5SEpx5m8EeVL0a9iIB/hreSd/ExuM9yFowQbK9swVLwZw='} 2023-06-22T15:25:04.381 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-22T15:25:04.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:25:04.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:25:04.433 INFO:teuthology.orchestra.console:Power off smithi159 2023-06-22T15:25:04.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:25:04.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:25:04.548 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-22T15:25:04.579 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-06-22T15:25:04.710 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-06-22T15:25:04.735 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com