2023-07-13T02:06:51.015 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-13T02:06:51.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:06:51.018 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:06:51.175 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f27841a08b0>, signals=[15]) 2023-07-13T02:06:51.177 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-13T02:06:51.177 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T02:06:51.177 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-13T02:06:51.200 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-07-13T02:06:51.200 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T02:06:51.200 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-07-13T02:06:51.202 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-13T02:06:51.225 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-07-13T02:06:51.284 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-13T02:06:51.295 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-13T02:06:51.325 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-13T02:06:51.325 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 5} 2023-07-13T02:06:51.335 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-13T02:06:51.336 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 5} 2023-07-13T02:06:51.370 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6 2023-07-13T02:06:51.371 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:06:51.384 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of rhel 8.6 2023-07-13T02:06:51.384 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:06:51.421 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T02:06:51.424 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T02:06:51.460 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-07-13T02:06:51.462 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-13T02:06:51.510 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:06:51.513 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:06:51.595 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-13T02:06:51.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:06:51.611 INFO:teuthology.orchestra.console:Power off smithi077 2023-07-13T02:06:51.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:06:51.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:51.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:51.742 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-13T02:06:51.752 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-07-13T02:06:51.844 INFO:teuthology.orchestra.console:Power on smithi038 2023-07-13T02:06:51.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T02:06:51.853 INFO:teuthology.orchestra.console:Power on smithi077 2023-07-13T02:06:51.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T02:06:51.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:51.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:55.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:55.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:06:56.106 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2023-07-13T02:06:56.208 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-07-13T02:06:56.208 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:07:00.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:07:00.210 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-07-13T02:07:00.311 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-13T02:07:00.311 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:07:11.276 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:07:15.376 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:07:26.339 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:07:30.432 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:07:41.399 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:07:45.488 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:07:56.460 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:08:00.540 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:08:11.528 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:08:15.596 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:08:26.589 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:08:30.653 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:08:41.652 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:08:45.700 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:08:56.724 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:09:00.760 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:09:11.780 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:09:15.824 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:09:26.845 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:09:30.880 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-13T02:09:30.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:09:34.004 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:09:40.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:09:41.900 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-13T02:09:41.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:09:43.088 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:09:45.012 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:09:49.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:09:51.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:09:52.144 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:09:54.096 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:09:58.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:00.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:01.200 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:10:03.152 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:10:07.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:09.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:10.256 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:10:12.208 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:10:16.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:18.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:19.312 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-13T02:10:21.264 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:10:25.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:27.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:10:30.324 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-13T02:10:36.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:11:25.364 WARNING:teuthology.provision.fog.smithi038:timed out 2023-07-13T02:11:31.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:11:31.706 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T02:11:31.707 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T02:11:31.988 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-13T02:11:31.988 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-13T02:11:32.007 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-13T02:11:32.008 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-13T02:11:32.065 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-13T02:11:32.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-13T02:11:32.215 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-13T02:11:32.245 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-13T02:11:32.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-13T02:11:32.383 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-13T02:11:32.451 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-13T02:11:32.508 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T02:11:32.509 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T02:11:32.509 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-07-13T02:11:32.509 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-07-13T02:11:32.509 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-07-13T02:11:32.509 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T02:11:32.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-13T02:11:32.511 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T02:11:32.511 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T02:11:32.511 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T02:11:32.511 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T02:11:32.512 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-13T02:11:32.513 DEBUG:teuthology.parallel:result is None 2023-07-13T02:11:36.332 WARNING:teuthology.provision.fog.smithi077:timed out 2023-07-13T02:11:42.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:11:42.672 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T02:11:42.672 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T02:11:42.924 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-07-13T02:11:42.924 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-07-13T02:11:42.942 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-07-13T02:11:42.942 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-07-13T02:11:43.000 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-07-13T02:11:43.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-07-13T02:11:43.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-07-13T02:11:43.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-07-13T02:11:43.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-07-13T02:11:43.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-07-13T02:11:43.358 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-07-13T02:11:43.415 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T02:11:43.416 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T02:11:43.416 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2023-07-13T02:11:43.416 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2023-07-13T02:11:43.417 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2023-07-13T02:11:43.417 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-07-13T02:11:43.417 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T02:11:43.417 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-07-13T02:11:43.418 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T02:11:43.418 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T02:11:43.418 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T02:11:43.418 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T02:11:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-13T02:11:43.419 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T02:11:43.419 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T02:11:43.419 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T02:11:43.419 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T02:11:43.419 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-07-13T02:11:43.421 DEBUG:teuthology.parallel:result is None 2023-07-13T02:11:43.575 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-13T02:11:43.576 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T02:11:43.605 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-07-13T02:11:43.606 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T02:11:43.630 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-13T02:11:43.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-13T02:11:43.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:11:43.703 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-13T02:11:43.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-13T02:11:43.835 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-13T02:11:43.892 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-13T02:11:43.893 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-13T02:11:43.950 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T02:11:43.950 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T02:11:43.950 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-13T02:11:43.951 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T02:11:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T02:11:43.953 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T02:11:43.953 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-13T02:11:43.979 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-07-13T02:11:43.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-13T02:11:43.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T02:11:44.045 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-07-13T02:11:44.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-13T02:11:44.119 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-07-13T02:11:44.174 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-07-13T02:11:44.175 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-07-13T02:11:44.230 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-07-13T02:11:44.231 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-13T02:11:44.232 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T02:11:44.233 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-13T02:11:44.233 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-13T02:11:44.233 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-13T02:11:44.233 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-07-13T02:11:44.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:11:44.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:11:44.350 INFO:teuthology.dispatcher.supervisor:Running job 7335639 2023-07-13T02:11:44.351 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335639 --name gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} -- /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335639/orig.config.yaml 2023-07-13T02:11:44.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335639 2023-07-13T02:11:44.355 INFO:teuthology.dispatcher.supervisor:Job PID: 21443 2023-07-13T02:11:44.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T02:13:44.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:13:44.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:15:44.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:15:44.633 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:17:44.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:17:44.814 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:19:44.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:19:44.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:21:45.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:21:45.172 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:23:45.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:23:45.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:25:45.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:25:45.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:27:45.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:27:45.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:29:45.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:29:45.898 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:31:46.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:31:46.090 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:33:46.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:33:46.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:35:46.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:35:46.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:37:46.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:37:46.628 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:39:46.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:39:46.805 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:41:46.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:41:46.982 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:43:47.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:43:47.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:43:47.240 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T02:43:47.337 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T02:43:47.337 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T02:43:47.388 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-13T02:43:47.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:43:47.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 02:06:50.236578', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-13T02:43:47.416 DEBUG:teuthology.nuke:shortname: smithi077 2023-07-13T02:43:47.416 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:43:47.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 02:06:50.238389', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-13T02:43:47.459 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-13T02:43:47.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:43:47.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:43:47.506 INFO:teuthology.orchestra.console:Power off smithi077 2023-07-13T02:43:47.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:43:47.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:43:47.616 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-13T02:43:47.647 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-07-13T02:43:47.772 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-07-13T02:43:47.798 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com