2023-07-27T22:49:06.765 INFO:root:teuthology version: 0.0.1.dev165+g3117e89 2023-07-27T22:49:06.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T22:49:06.767 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T22:49:06.929 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3797311310>, signals=[15]) 2023-07-27T22:49:06.931 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-07-27T22:49:06.931 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T22:49:06.932 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-07-27T22:49:06.959 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-27T22:49:06.959 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T22:49:06.959 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-27T22:49:06.961 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-07-27T22:49:06.983 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-27T22:49:07.034 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-27T22:49:07.051 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-27T22:49:07.071 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-27T22:49:07.072 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 7} 2023-07-27T22:49:07.088 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-27T22:49:07.088 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 7} 2023-07-27T22:49:07.119 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of rhel 8.4 2023-07-27T22:49:07.119 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:49:07.140 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.4 2023-07-27T22:49:07.140 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:49:07.178 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T22:49:07.188 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T22:49:07.218 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-07-27T22:49:07.236 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-27T22:49:07.269 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:49:07.295 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:49:07.353 INFO:teuthology.orchestra.console.smithi089:Power off 2023-07-27T22:49:07.353 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T22:49:07.372 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-27T22:49:07.373 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T22:49:07.384 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-07-27T22:49:07.384 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:07.397 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-27T22:49:07.397 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:07.405 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-07-27T22:49:07.417 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-27T22:49:11.408 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:11.417 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:11.517 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-07-27T22:49:11.527 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-27T22:49:15.521 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:15.529 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:15.631 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-07-27T22:49:15.641 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-27T22:49:15.742 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-27T22:49:15.842 INFO:teuthology.orchestra.console.smithi093:Power on 2023-07-27T22:49:15.843 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T22:49:15.864 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-07-27T22:49:15.865 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:15.885 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-27T22:49:19.636 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:19.745 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-07-27T22:49:19.846 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-07-27T22:49:19.887 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:19.947 INFO:teuthology.orchestra.console.smithi089:Power on 2023-07-27T22:49:19.948 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T22:49:19.967 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-07-27T22:49:19.968 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:19.986 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-07-27T22:49:19.996 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-27T22:49:23.992 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:23.999 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T22:49:24.101 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-07-27T22:49:24.109 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-27T22:49:24.202 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-07-27T22:49:24.210 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-07-27T22:49:24.304 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-07-27T22:49:24.304 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:49:24.312 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-27T22:49:24.312 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:49:39.388 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:49:39.389 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:49:54.453 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:49:54.454 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:50:09.529 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:50:09.531 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:50:24.596 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:50:24.598 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:50:39.669 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:50:39.670 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:50:54.736 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:50:54.738 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:51:09.804 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:51:09.805 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:51:24.876 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:51:24.878 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:51:39.940 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:51:39.941 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:51:54.996 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:51:54.998 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:52:10.056 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-27T22:52:10.058 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-27T22:52:10.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:10.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:28.656 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-27T22:52:28.657 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-27T22:52:34.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:34.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:37.712 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-27T22:52:37.744 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-27T22:52:43.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:43.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:46.768 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-27T22:52:46.800 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-27T22:52:52.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:52.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:52:55.824 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-27T22:52:55.856 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-27T22:53:01.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:53:01.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:53:04.912 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-27T22:53:10.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:54:01.881 WARNING:teuthology.provision.fog.smithi093:timed out 2023-07-27T22:54:07.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:54:08.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T22:54:08.313 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T22:54:08.573 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-27T22:54:08.573 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-27T22:54:08.630 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093 2023-07-27T22:54:08.631 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts 2023-07-27T22:54:08.687 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-27T22:54:08.688 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-27T22:54:08.796 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts 2023-07-27T22:54:08.820 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-27T22:54:08.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname 2023-07-27T22:54:08.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-27T22:54:09.019 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-27T22:54:09.076 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-07-27T22:54:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.4 (Ootpa)" 2023-07-27T22:54:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-07-27T22:54:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-07-27T22:54:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.4" 2023-07-27T22:54:09.077 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T22:54:09.078 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-27T22:54:09.079 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T22:54:09.079 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-27T22:54:09.079 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-27T22:54:09.079 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-27T22:54:09.080 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-27T22:54:09.081 DEBUG:teuthology.parallel:result is None 2023-07-27T22:54:10.919 WARNING:teuthology.provision.fog.smithi089:timed out 2023-07-27T22:54:16.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:54:17.321 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T22:54:17.322 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T22:54:17.594 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-07-27T22:54:17.594 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-07-27T22:54:17.610 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-07-27T22:54:17.610 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-07-27T22:54:17.664 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-07-27T22:54:17.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-07-27T22:54:17.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-07-27T22:54:17.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-07-27T22:54:17.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-07-27T22:54:17.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-07-27T22:54:17.987 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-07-27T22:54:18.039 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-07-27T22:54:18.040 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.4 (Ootpa)" 2023-07-27T22:54:18.040 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-07-27T22:54:18.040 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-07-27T22:54:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.4" 2023-07-27T22:54:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-07-27T22:54:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-27T22:54:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-07-27T22:54:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T22:54:18.042 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-27T22:54:18.043 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-27T22:54:18.043 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-27T22:54:18.043 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-07-27T22:54:18.044 DEBUG:teuthology.parallel:result is None 2023-07-27T22:54:18.204 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-07-27T22:54:18.205 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T22:54:18.237 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-27T22:54:18.237 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T22:54:18.263 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-07-27T22:54:18.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-27T22:54:18.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:54:18.330 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-07-27T22:54:18.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-27T22:54:18.394 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-07-27T22:54:18.447 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-07-27T22:54:18.448 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-07-27T22:54:18.500 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-07-27T22:54:18.500 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.4 (Ootpa)" 2023-07-27T22:54:18.500 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-07-27T22:54:18.500 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.4" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-07-27T22:54:18.501 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-27T22:54:18.502 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-27T22:54:18.503 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-07-27T22:54:18.528 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-27T22:54:18.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T22:54:18.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T22:54:18.596 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-27T22:54:18.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-27T22:54:18.669 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-27T22:54:18.725 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-27T22:54:18.725 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-27T22:54:18.781 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-07-27T22:54:18.781 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.4 (Ootpa)" 2023-07-27T22:54:18.781 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-07-27T22:54:18.781 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-07-27T22:54:18.781 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.4" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T22:54:18.782 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-07-27T22:54:18.783 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T22:54:18.783 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-27T22:54:18.783 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-27T22:54:18.783 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-27T22:54:18.783 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-27T22:54:18.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T22:54:18.812 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T22:54:18.900 INFO:teuthology.dispatcher.supervisor:Running job 7354828 2023-07-27T22:54:18.900 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7354828 --name yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} -- /home/teuthworker/archive/yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7354828/orig.config.yaml 2023-07-27T22:54:18.904 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7354828 2023-07-27T22:54:18.905 INFO:teuthology.dispatcher.supervisor:Job PID: 26633 2023-07-27T22:54:18.905 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-27T22:56:19.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T22:56:19.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T22:58:19.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T22:58:19.178 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:00:19.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:00:19.350 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:02:19.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:02:19.527 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:04:19.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:04:19.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:06:19.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:06:19.931 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:08:20.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:08:20.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:10:20.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:10:20.267 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:12:20.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:12:20.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:14:20.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:14:20.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:16:20.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:16:20.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:18:20.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:18:20.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:20:21.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:20:21.122 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:22:21.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:22:21.229 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:24:21.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:24:21.397 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:26:21.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T23:26:21.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T23:26:21.635 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-27T23:26:21.866 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-27T23:26:21.866 INFO:teuthology.nuke:Checking targets against current locks 2023-07-27T23:26:21.923 DEBUG:teuthology.nuke:shortname: smithi089 2023-07-27T23:26:21.923 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T23:26:21.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7354828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 22:49:05.953655', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4iuW4QKZ2rqV8xz6FsXD09ErNItJC694pFJbAheiZWVppyVeAh9Q9nL5gJnTQ2IUyMBInGoLLp2vw0/mpmyS6Mr4TooGjhBU8viYt/hcjzwc4aGyH0Ahaz/ZzgeU++GRlqMrNqyUv6ZCmDsDoKsVEA4xp7GjQKAmG0+JrZdaDfOLlSEOKFvKPr6/EMy5XnAA1LonXJj+ESwMe+OcZ+x10FLpOpeIcqTo0b2oU0ZoR+CezofTZ6ETz6T98wo1qw0n6EbpWHjUYgbA2RixiEiGH0b7SSO0BLKiyFvf99U+mRVYTgQdqWdDSjrGaKxeJy0aUGxzw//2Whaxnh3HfW1iq5J8VnliGyJjmDq1ORTTNrRdYmvFesPZffxZGzSBTfJyjq663HdKkREcYOPYc8W0sqPbgr2/kLgVC75M2NW0lmwkzhEuRGimOtOZkvyjxeBBpSkII5VZRhP0AWWaWd+mE8XtbjqyUrNFHhm4MMwucDzT0HVs1NrpYVg66tll+MGM='} 2023-07-27T23:26:21.950 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-27T23:26:21.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T23:26:21.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_22:37:12-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7354828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 22:49:05.952324', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjgVSvLPO/ASKfarbw0DQHelOy4JMvkkxDqSSJ3X6KrhuCWlEg12Gh/di7BpE3b42++0Su4iuFIzbp0TzjXDSuVAocxtiznJAyH5cTAHo6jWXm/6c4NbXA+8LNJaPIzZPXpyAe0n/w0hY0T6B/LeOkFQsBbTcAFavoLOYNz71kgbMCUDYZeKJGR6vQRzmwFo3oQ0R6SxOvTE3wNNFw4Ra9pYoW5wk1DL2O5PNiqAEvsUyq6rS1UmH+Etf1X+cxF4ywAfFU0nfF7/zaEjubQzvxVr2FVDP4weuJnvmbJMdqJH916Bd418/7xStA05OgLFNXz8sKVEKgahYkR26DFKIEB57hwJ6uCI2RVFZHloqgc7epq5mqK/lL+sXf5jYEVnxnGCVrxfQTEcVX67SkbeWW6dGUZgg/AVg8YAOMIXWPdcq7PK1cBElFHAOGWt7n9Qne1VvPwuv0LP8xKhY/4VS542+zTnXJZEIhjnLKIRkcFCZ9Ix1yfMEE9eO8Sy7hSK8='} 2023-07-27T23:26:22.010 INFO:teuthology.orchestra.console.smithi089:Power off 2023-07-27T23:26:22.011 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T23:26:22.029 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-27T23:26:22.030 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T23:26:22.040 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-07-27T23:26:22.040 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T23:26:22.051 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-27T23:26:22.052 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T23:26:22.061 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-07-27T23:26:22.072 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-27T23:26:22.162 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-07-27T23:26:22.173 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-27T23:26:22.318 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2023-07-27T23:26:22.327 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com