2023-07-12T01:24:59.522 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T01:24:59.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:24:59.524 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:24:59.672 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68f11fc820>, signals=[15]) 2023-07-12T01:24:59.674 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-12T01:24:59.674 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T01:24:59.674 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-12T01:24:59.702 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-07-12T01:24:59.703 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T01:24:59.703 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-12T01:24:59.704 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-12T01:24:59.727 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-07-12T01:24:59.778 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T01:24:59.788 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T01:24:59.818 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T01:24:59.819 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 5} 2023-07-12T01:24:59.826 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T01:24:59.826 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 5} 2023-07-12T01:24:59.864 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6 2023-07-12T01:24:59.864 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:24:59.867 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2023-07-12T01:24:59.867 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:24:59.937 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T01:24:59.942 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T01:24:59.970 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-12T01:24:59.973 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-07-12T01:25:00.036 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:25:00.039 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:25:00.149 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-12T01:25:00.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:25:00.164 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-12T01:25:00.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:25:00.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:00.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:04.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:04.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:08.522 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-12T01:25:08.623 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-12T01:25:08.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T01:25:08.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.644 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-12T01:25:12.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:12.745 INFO:teuthology.orchestra.console:Power on smithi158 2023-07-12T01:25:12.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T01:25:12.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:16.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:16.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:25:16.994 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-12T01:25:17.001 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-07-12T01:25:17.095 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-12T01:25:17.096 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:25:17.101 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-07-12T01:25:17.102 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:25:32.252 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:25:32.253 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:25:47.395 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:25:47.397 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:26:02.544 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:26:02.546 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:26:17.716 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:26:17.717 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:26:32.898 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:26:32.899 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:26:48.074 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:26:48.076 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:27:03.257 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:27:03.259 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:27:18.468 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:27:18.469 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:27:33.657 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:27:33.658 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:27:48.880 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:27:48.882 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-12T01:27:49.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:27:52.144 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-12T01:27:58.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:28:01.232 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-12T01:28:04.073 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:28:07.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:28:10.288 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-12T01:28:16.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:28:19.272 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:28:19.344 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-12T01:28:25.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:28:34.446 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:28:49.620 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:29:04.759 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:29:19.921 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:29:25.352 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-12T01:29:31.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:29:31.599 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:29:31.599 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:29:31.901 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-12T01:29:31.902 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-12T01:29:31.919 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-12T01:29:31.920 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-12T01:29:31.977 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-12T01:29:31.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-12T01:29:32.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-12T01:29:32.132 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-12T01:29:32.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-12T01:29:32.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-12T01:29:32.339 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-12T01:29:32.396 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:29:32.397 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:29:32.397 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-07-12T01:29:32.397 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-07-12T01:29:32.397 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-07-12T01:29:32.397 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:29:32.398 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:29:32.399 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-07-12T01:29:32.399 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:29:32.399 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:29:32.399 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:29:32.399 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:29:32.400 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-12T01:29:32.402 DEBUG:teuthology.parallel:result is None 2023-07-12T01:29:35.076 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:29:50.232 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:30:05.396 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:30:20.546 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:30:35.672 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:30:50.810 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:31:05.932 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:31:21.058 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:31:36.184 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:31:51.302 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:32:06.401 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T01:32:06.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:32:06.551 ERROR:teuthology.orchestra.connection:Error authenticating with smithi158.front.sepia.ceph.com: Authentication failed. 2023-07-12T01:32:06.553 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:32:06.553 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:32:06.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-12T01:35:46.801 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-12T01:35:46.802 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi158 2023-07-12T01:35:55.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T01:35:55.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:56.131 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-07-12T01:35:56.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T01:35:56.421 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T01:35:56.422 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T01:35:56.439 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-07-12T01:35:56.439 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-07-12T01:35:56.496 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158 2023-07-12T01:35:56.497 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158 /etc/hosts 2023-07-12T01:35:56.553 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-07-12T01:35:56.554 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-12T01:35:56.678 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hosts 2023-07-12T01:35:56.705 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-07-12T01:35:56.772 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hostname 2023-07-12T01:35:56.839 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-12T01:35:56.905 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-12T01:35:56.961 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-07-12T01:35:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-07-12T01:35:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-07-12T01:35:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-07-12T01:35:56.964 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:56.964 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:56.964 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:56.964 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:56.965 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-07-12T01:35:56.965 DEBUG:teuthology.parallel:result is None 2023-07-12T01:35:57.138 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-12T01:35:57.139 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-07-12T01:35:57.140 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T01:35:57.169 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-12T01:35:57.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-12T01:35:57.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:57.244 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-12T01:35:57.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-12T01:35:57.384 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-12T01:35:57.441 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-12T01:35:57.442 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-12T01:35:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-07-12T01:35:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-07-12T01:35:57.499 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:57.500 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:57.501 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-07-12T01:35:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:57.501 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:57.502 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-12T01:35:57.523 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-07-12T01:35:57.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T01:35:57.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:35:57.589 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-07-12T01:35:57.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T01:35:57.658 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-07-12T01:35:57.715 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-07-12T01:35:57.716 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-12T01:35:57.772 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T01:35:57.772 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T01:35:57.772 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T01:35:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T01:35:57.774 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T01:35:57.774 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:35:57.774 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-07-12T01:35:57.774 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:35:57.774 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T01:35:57.775 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T01:35:57.775 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T01:35:57.775 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-12T01:35:57.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:35:57.799 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:35:57.888 INFO:teuthology.dispatcher.supervisor:Running job 7334512 2023-07-12T01:35:57.889 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334512 --name pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334512/orig.config.yaml 2023-07-12T01:35:57.893 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334512 2023-07-12T01:35:57.894 INFO:teuthology.dispatcher.supervisor:Job PID: 20681 2023-07-12T01:35:57.894 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T01:37:57.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:37:57.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:39:58.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:39:58.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:41:58.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:41:58.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:43:58.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:43:58.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:45:58.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:45:58.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:47:58.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:47:58.855 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:49:58.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:49:58.996 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:51:59.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:51:59.063 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T01:51:59.129 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T01:51:59.242 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T01:51:59.243 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T01:51:59.295 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-12T01:51:59.295 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T01:51:59.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334512', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:58.636084', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T01:51:59.323 DEBUG:teuthology.nuke:shortname: smithi158 2023-07-12T01:51:59.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T01:51:59.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334512', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:58.638075', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T01:51:59.364 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-12T01:51:59.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:51:59.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:51:59.402 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-12T01:51:59.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T01:51:59.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T01:51:59.513 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-12T01:51:59.549 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-12T01:51:59.670 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-12T01:51:59.695 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com