2023-06-24T19:02:47.818 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-24T19:02:47.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:02:47.820 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:02:47.984 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8377b29d30>, signals=[15]) 2023-06-24T19:02:47.986 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-06-24T19:02:47.986 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-06-24T19:02:47.986 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-06-24T19:02:48.012 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-06-24T19:02:48.013 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-06-24T19:02:48.013 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-24T19:02:48.014 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-06-24T19:02:48.037 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-06-24T19:02:48.088 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-24T19:02:48.113 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-24T19:02:48.126 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2023-06-24T19:02:48.126 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3} 2023-06-24T19:02:48.153 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3) 2023-06-24T19:02:48.154 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 3} 2023-06-24T19:02:48.174 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2023-06-24T19:02:48.174 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:02:48.204 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream 2023-06-24T19:02:48.204 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:02:48.264 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-06-24T19:02:48.276 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-06-24T19:02:48.302 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-06-24T19:02:48.314 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-06-24T19:02:48.363 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:02:48.370 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:02:48.487 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-24T19:02:48.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T19:02:48.504 INFO:teuthology.orchestra.console:Power off smithi132 2023-06-24T19:02:48.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T19:02:48.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:48.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:48.651 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-06-24T19:02:48.752 INFO:teuthology.orchestra.console:Power on smithi132 2023-06-24T19:02:48.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-24T19:02:48.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:52.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:52.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:56.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:56.862 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-24T19:02:56.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:56.963 INFO:teuthology.orchestra.console:Power on smithi195 2023-06-24T19:02:56.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-24T19:02:56.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:02:57.121 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2023-06-24T19:02:57.222 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-06-24T19:02:57.223 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:03:01.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:03:05.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:03:05.336 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-06-24T19:03:05.437 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-06-24T19:03:05.438 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:03:12.332 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:03:20.544 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:03:27.440 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:03:35.632 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:03:42.537 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:03:50.734 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:03:57.642 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:04:05.836 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:04:12.764 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:04:20.960 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:04:27.860 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:04:36.051 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:04:42.968 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:04:51.136 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:04:58.072 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:05:06.232 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:05:13.160 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:05:21.328 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:05:28.254 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:05:36.408 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-24T19:05:36.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:05:36.776 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication failed. 2023-06-24T19:05:43.325 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-06-24T19:05:43.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:05:46.480 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-24T19:05:52.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:05:55.536 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-24T19:06:01.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:04.592 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-24T19:06:10.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:12.464 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-24T19:06:13.652 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-24T19:06:18.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:19.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:21.520 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-24T19:06:22.704 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-24T19:06:27.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:28.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:06:30.576 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-24T19:06:36.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:07:28.707 WARNING:teuthology.provision.fog.smithi132:timed out 2023-06-24T19:07:34.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:07:34.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-24T19:07:34.921 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-24T19:07:35.157 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-06-24T19:07:35.158 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-06-24T19:07:35.218 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-06-24T19:07:35.219 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-06-24T19:07:35.279 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-06-24T19:07:35.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-06-24T19:07:35.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-06-24T19:07:35.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-06-24T19:07:35.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-06-24T19:07:35.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-06-24T19:07:35.618 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-06-24T19:07:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-06-24T19:07:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-06-24T19:07:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-06-24T19:07:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T19:07:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T19:07:35.678 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T19:07:35.678 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-06-24T19:07:35.679 DEBUG:teuthology.parallel:result is None 2023-06-24T19:07:36.579 WARNING:teuthology.provision.fog.smithi195:timed out 2023-06-24T19:07:42.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:07:42.776 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-24T19:07:42.777 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-24T19:07:43.012 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-06-24T19:07:43.012 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-06-24T19:07:43.030 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-06-24T19:07:43.030 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-06-24T19:07:43.089 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-06-24T19:07:43.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-06-24T19:07:43.196 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-06-24T19:07:43.225 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-06-24T19:07:43.294 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-06-24T19:07:43.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-06-24T19:07:43.428 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-06-24T19:07:43.486 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-06-24T19:07:43.486 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-06-24T19:07:43.486 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T19:07:43.487 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-06-24T19:07:43.488 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T19:07:43.488 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T19:07:43.488 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T19:07:43.488 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-06-24T19:07:43.489 DEBUG:teuthology.parallel:result is None 2023-06-24T19:07:43.640 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-06-24T19:07:43.641 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-24T19:07:43.668 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-06-24T19:07:43.669 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-24T19:07:43.694 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-06-24T19:07:43.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-24T19:07:43.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:07:43.760 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-06-24T19:07:43.788 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-06-24T19:07:43.847 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-06-24T19:07:43.847 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-06-24T19:07:43.906 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-06-24T19:07:43.906 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-06-24T19:07:43.907 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T19:07:43.908 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-06-24T19:07:43.908 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T19:07:43.908 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T19:07:43.908 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T19:07:43.909 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-06-24T19:07:43.935 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-06-24T19:07:43.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-06-24T19:07:43.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T19:07:43.999 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-06-24T19:07:44.023 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-06-24T19:07:44.081 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-06-24T19:07:44.081 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-06-24T19:07:44.139 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-06-24T19:07:44.139 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-06-24T19:07:44.139 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T19:07:44.140 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-06-24T19:07:44.141 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T19:07:44.141 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T19:07:44.141 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T19:07:44.141 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-24T19:07:44.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:07:44.168 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:07:44.278 INFO:teuthology.dispatcher.supervisor:Running job 7313629 2023-06-24T19:07:44.278 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7313629 --name teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} -- /home/teuthworker/archive/teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7313629/orig.config.yaml 2023-06-24T19:07:44.283 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7313629 2023-06-24T19:07:44.284 INFO:teuthology.dispatcher.supervisor:Job PID: 31658 2023-06-24T19:07:44.284 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-24T19:09:44.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:09:44.287 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:11:44.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:11:44.357 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:13:44.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:13:44.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:15:44.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:15:44.504 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:17:44.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:17:44.601 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:19:44.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:19:44.677 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:21:44.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:21:44.757 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:23:44.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:23:44.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:25:44.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:25:44.903 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:27:44.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:27:44.979 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:29:45.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:29:45.051 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:31:45.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:31:45.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:33:45.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:33:45.181 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:35:45.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:35:45.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:37:45.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:37:45.336 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:39:45.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:39:45.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:41:45.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:41:45.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:43:45.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:43:45.580 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:45:45.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:45:45.651 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:47:45.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:47:45.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:49:45.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:49:45.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:51:45.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:51:45.873 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:53:45.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:53:45.947 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:55:46.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T19:55:46.019 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T19:55:46.092 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-24T19:55:46.208 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-24T19:55:46.208 INFO:teuthology.nuke:Checking targets against current locks 2023-06-24T19:55:46.260 DEBUG:teuthology.nuke:shortname: smithi132 2023-06-24T19:55:46.260 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T19:55:46.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7313629', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 19:02:47.022295', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVBHV9pLdTa8k1ZVZu8ch56H9WtaasGJX9Y9qGhxzoD/uzkeITknOu/Cq+sH12EMlQZXdeqoIWmmcRmLQs7oQELKEy5ByPdp6VL9kZOKKwcCx0JlDmmfc8IaRIV1MgtZxvT1fEVlU5FlT+4Swv8yhFlJpuZcM/Tx8pCiEY0BwIAHJfw/yfMPH9hu54Kgvf4ylNTMmqH23G3a+R4BI+0iXHnj/7ktOaAsyDHxfuhGw6CBIVRKU3/2iX+4kj8E2gwfWTJ3LKdJzJDRs5tXfXMnFR27/vdov/SJjTjXmSd//VcwolFg0uLN5VbrU+CwOm7DTnR6s3GsNRWlzlldjahLVB6IhNRSWYtBWIpS1yDNgvi7jLGf65HFaRhffnqpzDMGj0fedWWTsvvqc7rt6Mae2TPzvZ5kxwwTqMXxUvjplWl1QfGmxgIUWEJUulK9laOVRxdcbKTuf1wT3KFKzFQCYVkp79kdqu0yg0Tuzrf/17d/kcL/QoLerWxZwdrOw4Pfc='} 2023-06-24T19:55:46.287 DEBUG:teuthology.nuke:shortname: smithi195 2023-06-24T19:55:46.288 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T19:55:46.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-06-23_14:22:11-upgrade:octopus-x-quincy-distro-default-smithi/7313629', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 19:02:47.023648', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS0cP+uKVa+kYnnvRUNEh1niYDai0szLLT8d3RoVWFfUcJyHZ2Q3QJTldJebl7HSdu/DPzCMZZdmuW92ObI6JxbJhM8kBII5nzHV5o3XUNtwIWLJ844mDxvu/eHb1QMwH8j5dfHN/t3lwrrRhuVbJSdwtl6qheC0XCgqtD9RgDygtOC/szfCjyrasXRQGzptFUHZzMtYsJ0+I7m8g9C8tmlIjY+KKhKS938UMMvU/aKVTzwfK6st/bLo/mDxTrphnbCeGHHrW6sxOps94IAkZDZXaJgq67AMHJVdVCJqcMXXZnoVmJuv49Ezm0ewKhFgdSOQ2wCwlc1O+hyAQCJuPn2f1drs23FcOVA9zRDWvvjLiD/VjQFPq5c0kwWkcFrAQffhSoazN47GgJ5/qRWbyCNzLLcAwT/o4+4/jJPjCn6IQBkaRSH+XipIE41GQSTBcuS+TBSvVLj3/ob9Qhjh1IUI8cVTcAf35fE6Y26YJeIevi+pWU6T/9upKirP2tuvM='} 2023-06-24T19:55:46.343 INFO:teuthology.orchestra.console:Power off smithi132 2023-06-24T19:55:46.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T19:55:46.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:55:46.384 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-24T19:55:46.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T19:55:46.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T19:55:46.496 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-06-24T19:55:46.529 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-24T19:55:46.665 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-06-24T19:55:46.682 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com