2023-06-20T21:15:35.096 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T21:15:35.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:15:35.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:15:35.243 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12535198b0>, signals=[15]) 2023-06-20T21:15:35.244 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-06-20T21:15:35.244 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T21:15:35.245 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-06-20T21:15:35.271 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-06-20T21:15:35.272 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T21:15:35.272 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-20T21:15:35.273 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-06-20T21:15:35.296 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-06-20T21:15:35.363 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T21:15:35.379 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T21:15:35.404 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T21:15:35.404 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 5} 2023-06-20T21:15:35.417 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T21:15:35.417 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 5} 2023-06-20T21:15:35.446 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2023-06-20T21:15:35.446 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:15:35.465 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2023-06-20T21:15:35.465 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:15:35.487 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T21:15:35.502 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T21:15:35.521 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-06-20T21:15:35.531 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-06-20T21:15:35.567 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:15:35.600 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:15:35.647 INFO:teuthology.orchestra.console:Power off smithi026 2023-06-20T21:15:35.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T21:15:35.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:35.693 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-20T21:15:35.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T21:15:35.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:39.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:39.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:43.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:43.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:44.028 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-06-20T21:15:44.055 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-20T21:15:44.130 INFO:teuthology.orchestra.console:Power on smithi026 2023-06-20T21:15:44.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T21:15:44.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:44.156 INFO:teuthology.orchestra.console:Power on smithi125 2023-06-20T21:15:44.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T21:15:44.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:48.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:48.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:52.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:52.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:15:52.496 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-06-20T21:15:52.516 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-06-20T21:15:52.598 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-06-20T21:15:52.598 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:15:52.617 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-06-20T21:15:52.618 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:16:07.671 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:16:07.673 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:16:22.744 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:16:22.745 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:16:37.807 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:16:37.809 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:16:52.880 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:16:52.882 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:17:07.956 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:17:07.958 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:17:23.032 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:17:23.033 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:17:38.114 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:17:38.115 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:17:53.185 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:17:53.186 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:18:08.244 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-20T21:18:08.246 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:18:08.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:11.376 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-20T21:18:17.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:20.464 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-20T21:18:23.301 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:18:26.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:29.520 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-20T21:18:35.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:38.366 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-20T21:18:38.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:38.608 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-20T21:18:41.488 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:18:44.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:47.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:47.664 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-20T21:18:50.544 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:18:53.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:56.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:18:59.600 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:19:05.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:19:08.688 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:19:14.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:19:17.776 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:19:23.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:19:26.832 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-20T21:19:32.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:19:53.673 WARNING:teuthology.provision.fog.smithi026:timed out 2023-06-20T21:19:59.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:19:59.921 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T21:19:59.922 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T21:20:00.181 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-06-20T21:20:00.182 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-06-20T21:20:00.199 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-06-20T21:20:00.199 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-06-20T21:20:00.256 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-06-20T21:20:00.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-06-20T21:20:00.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-06-20T21:20:00.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-06-20T21:20:00.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-06-20T21:20:00.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-06-20T21:20:00.604 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-06-20T21:20:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T21:20:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T21:20:00.660 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T21:20:00.661 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T21:20:00.662 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T21:20:00.663 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-06-20T21:20:00.664 DEBUG:teuthology.parallel:result is None 2023-06-20T21:20:32.844 WARNING:teuthology.provision.fog.smithi125:timed out 2023-06-20T21:20:38.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:20:39.195 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T21:20:39.196 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T21:20:39.472 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-06-20T21:20:39.473 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-06-20T21:20:39.491 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-06-20T21:20:39.492 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-06-20T21:20:39.551 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-06-20T21:20:39.552 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-20T21:20:39.674 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-06-20T21:20:39.708 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-06-20T21:20:39.780 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-06-20T21:20:39.853 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-20T21:20:39.924 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-20T21:20:39.984 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-06-20T21:20:39.985 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T21:20:39.986 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T21:20:39.987 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T21:20:39.987 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-06-20T21:20:39.987 DEBUG:teuthology.parallel:result is None 2023-06-20T21:20:40.176 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-06-20T21:20:40.177 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T21:20:40.205 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-06-20T21:20:40.205 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T21:20:40.231 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-06-20T21:20:40.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-06-20T21:20:40.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:20:40.298 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-06-20T21:20:40.430 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-06-20T21:20:40.487 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-06-20T21:20:40.488 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-06-20T21:20:40.550 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T21:20:40.551 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T21:20:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T21:20:40.553 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T21:20:40.553 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T21:20:40.553 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-06-20T21:20:40.580 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-06-20T21:20:40.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-06-20T21:20:40.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T21:20:40.645 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-06-20T21:20:40.715 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-06-20T21:20:40.772 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-06-20T21:20:40.773 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-20T21:20:40.830 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T21:20:40.830 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-06-20T21:20:40.831 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T21:20:40.832 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T21:20:40.833 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T21:20:40.833 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-20T21:20:40.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:20:40.855 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:20:40.953 INFO:teuthology.dispatcher.supervisor:Running job 7309274 2023-06-20T21:20:40.953 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi/7309274 --name cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} -- /home/teuthworker/archive/cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi/7309274/orig.config.yaml 2023-06-20T21:20:40.956 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi/7309274 2023-06-20T21:20:40.957 INFO:teuthology.dispatcher.supervisor:Job PID: 25761 2023-06-20T21:20:40.957 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T21:22:41.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:22:41.057 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:24:41.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:24:41.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:26:41.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:26:41.407 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:28:41.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:28:41.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:30:41.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:30:41.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:32:42.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:32:42.045 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:34:42.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:34:42.149 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:36:42.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:36:42.322 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:38:42.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:38:42.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:40:42.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T21:40:42.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T21:40:42.765 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T21:40:42.873 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T21:40:42.874 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T21:40:42.928 DEBUG:teuthology.nuke:shortname: smithi026 2023-06-20T21:40:42.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T21:40:42.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi/7309274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 21:15:34.349448', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-20T21:40:42.952 DEBUG:teuthology.nuke:shortname: smithi125 2023-06-20T21:40:42.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T21:40:42.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-20_21:14:58-fs-main-distro-default-smithi/7309274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 21:15:34.348104', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-20T21:40:42.998 INFO:teuthology.orchestra.console:Power off smithi026 2023-06-20T21:40:42.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T21:40:43.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:40:43.040 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-20T21:40:43.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T21:40:43.061 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T21:40:43.150 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-06-20T21:40:43.183 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-20T21:40:43.306 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-06-20T21:40:43.330 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com