2023-07-14T20:13:27.103 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T20:13:27.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:13:27.105 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:13:27.256 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0624fdf70>, signals=[15]) 2023-07-14T20:13:27.259 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-07-14T20:13:27.259 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T20:13:27.260 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-14T20:13:27.284 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-07-14T20:13:27.284 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T20:13:27.285 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-14T20:13:27.286 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-07-14T20:13:27.309 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-07-14T20:13:27.362 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T20:13:27.382 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T20:13:27.408 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T20:13:27.408 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 3} 2023-07-14T20:13:27.422 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T20:13:27.423 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 3} 2023-07-14T20:13:27.458 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2023-07-14T20:13:27.459 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:13:27.472 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream 2023-07-14T20:13:27.472 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:13:27.500 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T20:13:27.505 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T20:13:27.539 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-07-14T20:13:27.543 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-07-14T20:13:27.587 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:13:27.590 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:13:27.667 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-14T20:13:27.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T20:13:27.682 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-14T20:13:27.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T20:13:27.691 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:27.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:31.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:31.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:35.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:35.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:36.045 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-14T20:13:36.146 INFO:teuthology.orchestra.console:Power on smithi050 2023-07-14T20:13:36.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T20:13:39.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:41.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:45.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:45.279 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-14T20:13:45.380 INFO:teuthology.orchestra.console:Power on smithi195 2023-07-14T20:13:45.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T20:13:45.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:46.182 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:49.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:51.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:54.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:56.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:59.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:13:59.854 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-07-14T20:13:59.955 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-07-14T20:13:59.956 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:14:14.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:14:20.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:14:25.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:14:30.024 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:14:35.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:14:40.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T20:14:40.354 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2023-07-14T20:14:40.456 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-07-14T20:14:40.456 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:14:50.094 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:14:55.512 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:15:05.152 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:15:10.561 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:15:25.216 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:15:30.615 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:15:45.280 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:15:50.673 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:16:05.348 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:16:10.732 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:16:20.404 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:16:30.800 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:16:36.048 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-14T20:16:36.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:16:45.860 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:16:54.640 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-14T20:17:00.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:17:03.728 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-14T20:17:05.916 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:17:10.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:17:18.992 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-14T20:17:24.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:17:30.972 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:17:46.036 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T20:17:46.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:18:04.528 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-14T20:18:10.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:18:18.608 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-14T20:18:24.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:18:30.001 WARNING:teuthology.provision.fog.smithi195:timed out 2023-07-14T20:18:36.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:18:41.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T20:18:41.213 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T20:18:41.471 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-07-14T20:18:41.472 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-07-14T20:18:41.490 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-07-14T20:18:41.491 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-07-14T20:18:41.550 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-07-14T20:18:41.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-14T20:18:41.648 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-07-14T20:18:41.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-07-14T20:18:41.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-07-14T20:18:41.812 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-14T20:18:41.879 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-14T20:18:41.936 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-07-14T20:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-07-14T20:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-07-14T20:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-07-14T20:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-07-14T20:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T20:18:41.938 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T20:18:41.939 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-07-14T20:18:41.941 DEBUG:teuthology.parallel:result is None 2023-07-14T20:19:29.664 WARNING:teuthology.provision.fog.smithi050:timed out 2023-07-14T20:19:35.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:19:40.872 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T20:19:40.872 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T20:19:41.174 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-07-14T20:19:41.175 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-07-14T20:19:41.194 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-07-14T20:19:41.195 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-07-14T20:19:41.255 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-07-14T20:19:41.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-14T20:19:41.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-07-14T20:19:41.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-07-14T20:19:41.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-07-14T20:19:41.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-14T20:19:41.603 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-14T20:19:41.661 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T20:19:41.662 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-14T20:19:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T20:19:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-07-14T20:19:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T20:19:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T20:19:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T20:19:41.663 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-07-14T20:19:41.664 DEBUG:teuthology.parallel:result is None 2023-07-14T20:19:41.818 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-07-14T20:19:41.819 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T20:19:41.847 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-07-14T20:19:41.847 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T20:19:41.873 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-07-14T20:19:41.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T20:19:41.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:19:41.941 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-07-14T20:19:42.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T20:19:42.011 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-07-14T20:19:42.069 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-07-14T20:19:42.070 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-14T20:19:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-07-14T20:19:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-07-14T20:19:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-07-14T20:19:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-07-14T20:19:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T20:19:42.129 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T20:19:42.130 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-14T20:19:42.155 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-07-14T20:19:42.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-14T20:19:42.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T20:19:42.220 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-14T20:19:42.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-14T20:19:42.359 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-07-14T20:19:42.417 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-07-14T20:19:42.418 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-14T20:19:42.476 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-07-14T20:19:42.477 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-07-14T20:19:42.477 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-07-14T20:19:42.477 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T20:19:42.478 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T20:19:42.479 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T20:19:42.479 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-14T20:19:42.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:19:42.506 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:19:42.600 INFO:teuthology.dispatcher.supervisor:Running job 7337767 2023-07-14T20:19:42.600 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337767 --name yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337767/orig.config.yaml 2023-07-14T20:19:42.603 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337767 2023-07-14T20:19:42.604 INFO:teuthology.dispatcher.supervisor:Job PID: 873 2023-07-14T20:19:42.604 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T20:21:42.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:21:42.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:23:47.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:23:47.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:25:53.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:25:53.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:27:58.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:27:58.205 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:29:58.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:29:58.363 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:32:03.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:32:03.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:34:03.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:34:03.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:36:08.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:36:08.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:38:14.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:38:14.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:40:19.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:40:19.210 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:42:24.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:42:24.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:44:29.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:44:29.566 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:46:29.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:46:29.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:48:32.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:48:32.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:50:37.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:50:37.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:52:42.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:52:42.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:54:47.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:54:47.924 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:56:53.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:56:53.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:58:58.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:58:58.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:01:03.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:01:03.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:03:03.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:03:03.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:05:08.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:05:08.807 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:05:10.076 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T21:05:10.165 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T21:05:10.165 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T21:05:10.213 DEBUG:teuthology.nuke:shortname: smithi050 2023-07-14T21:05:10.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T21:05:10.236 DEBUG:teuthology.nuke:shortname: smithi195 2023-07-14T21:05:10.236 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T21:05:10.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337767', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 20:13:21.252710', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRRZMFUF5rVcIZXxdeL5i577z3TQZlm0+UHg6R0p4IUWO2Hzq3ffJ2q56mc7jxHvau/rKYhLz7vOjMbeuTfpnSQCY/vmU74MeblWIShnYflW1jwEmS3lguQbfuWXVywMThlaINihmlUhykFK54c2TlfY1eZQaU/q3qenz58pIznwB2TO0tIZZ6rtpLWBisQTUEkTfhgwBfWVAORwdW9HvM4oVMt0XqH+d7ZGPgFnZbQIUWSOmhBp4phksTabUD+7OhGNmV+6iS4WojIWddAB+MR5biLamrgY1Qhl2jcu21u8JU8ZjVbpfJvWuDSKfQUP9K3HLI1vxWSnnpPPn4xtmVXfbvXvWR94OX6q59Mgs0IKXO/YHwzSP4mS10i4LN/c3HOG1Uz9jf3QBXIsk8ev2QQ7e+rtU4mT1Uyq8SbnHeG4PnDaLb4lzjoxwPhPa9oFF+PTd73BSTkeHwRQd6+8sNrIDtT4CFMqP6uoELAhitX1p0MzQl/LgW5PKTyMOSz8='} 2023-07-14T21:05:10.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_13:57:22-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337767', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 20:13:21.250398', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLs1XecvaKLVmPW7STa1+Zr/LYeCGvOqCyXQdEHvnQNw/anXsAo+T+jhWpEJLO8yiz2PwZcm4jdOOxTDWaJ3D0Zc84+703s6BhOeh8GTrBLg4ZfXRrCDbTRV0/C/xNG1j5TMcjGpUZxxmk1kedaZA2MmxsWkOptPHfCy8G6gufKE7/fLTXNvuTq01JF0T7+OpqxSp4JWey7LV82QZDmIevqwrnPO1g915NNU+iQT5+CD3hOBbKhfYTomrwj9EKhMak5e0TmodvN56mA9f+ObCgV4isFDKTSj+8ss2IdmKpfSKlARt5TK2erSwVIZ2NzWOhpMVHDryKvUeyZ085Hf+pX6nlBIThkm5p8mX02bjScezEUk5XS1jqQKOJb0nTc0MuAMaCIezs9aFvAbG8Fgl7HTG3aOu7x1r+v4WEblUJLvu/avOcuggRbafH+/57Iro/BTUe+Tmo2c5nj4mCgyU/I1vGrKDdcMj9gIIJeNG1giWRKgVsVu7/GvEY9vf8fM8='} 2023-07-14T21:05:10.287 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-14T21:05:10.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:05:10.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:05:10.328 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-14T21:05:10.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:05:10.436 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-14T21:05:20.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:05:20.618 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-07-14T21:05:25.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:05:30.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:05:35.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:05:36.027 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-14T21:05:46.194 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com