2023-10-16T07:25:39.288 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T07:25:39.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:25:39.457 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f70af270c10>, signals=[15]) 2023-10-16T07:25:39.459 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-10-16T07:25:39.459 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:25:39.459 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-10-16T07:25:39.492 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-10-16T07:25:39.493 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T07:25:39.493 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-16T07:25:39.495 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-10-16T07:25:39.534 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-10-16T07:25:39.617 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:25:39.629 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T07:25:39.676 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:25:39.677 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 5} 2023-10-16T07:25:39.688 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T07:25:39.688 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5} 2023-10-16T07:25:39.747 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2023-10-16T07:25:39.747 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:25:39.758 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2023-10-16T07:25:39.759 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:25:39.818 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:25:39.829 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T07:25:39.878 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-10-16T07:25:39.897 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-10-16T07:25:39.958 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:25:39.979 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:25:40.069 INFO:teuthology.orchestra.console.smithi022:Power off 2023-10-16T07:25:40.070 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:25:40.083 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-16T07:25:40.084 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:25:40.099 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-10-16T07:25:40.100 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:40.113 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-16T07:25:40.113 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:40.130 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-10-16T07:25:40.167 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-16T07:25:40.231 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-10-16T07:25:40.269 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-16T07:25:40.333 INFO:teuthology.orchestra.console.smithi022:Power on 2023-10-16T07:25:40.333 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:25:40.365 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-10-16T07:25:40.366 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:40.373 INFO:teuthology.orchestra.console.smithi125:Power on 2023-10-16T07:25:40.374 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T07:25:40.402 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-10-16T07:25:40.403 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:40.415 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-10-16T07:25:40.453 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-16T07:25:44.422 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:44.454 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:44.531 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-10-16T07:25:44.563 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-16T07:25:44.633 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-10-16T07:25:44.734 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-10-16T07:25:44.734 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:25:48.566 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:25:48.675 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-16T07:25:48.776 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-10-16T07:25:48.877 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-10-16T07:25:48.877 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:25:59.820 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:26:03.953 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:26:14.903 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:26:19.031 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:26:29.978 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:26:34.102 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:26:45.050 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:26:49.170 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:27:00.122 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:27:04.254 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:27:15.194 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:27:19.322 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:27:30.316 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:27:34.390 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:27:45.394 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:27:49.464 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:28:00.478 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:28:04.542 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:28:15.550 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-10-16T07:28:15.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:28:19.610 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-16T07:28:19.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:28:34.170 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-10-16T07:28:40.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:28:43.258 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-10-16T07:28:49.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:28:52.346 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-10-16T07:28:58.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:29:01.438 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-10-16T07:29:07.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:29:50.386 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-10-16T07:29:57.470 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-16T07:30:03.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:30:03.815 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:30:03.816 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:30:04.108 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-10-16T07:30:04.109 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-10-16T07:30:04.125 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-10-16T07:30:04.126 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-10-16T07:30:04.183 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-10-16T07:30:04.185 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-16T07:30:04.299 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-10-16T07:30:04.326 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-10-16T07:30:04.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-10-16T07:30:04.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-16T07:30:04.526 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-16T07:30:04.583 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:30:04.584 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:30:04.584 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-10-16T07:30:04.584 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-10-16T07:30:04.584 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-10-16T07:30:04.585 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:30:04.585 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:30:04.585 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-16T07:30:04.586 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:30:04.586 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:30:04.586 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:30:04.586 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:30:04.586 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-16T07:30:04.587 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:30:04.587 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:30:04.587 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:30:04.588 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:30:04.589 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-10-16T07:30:04.590 DEBUG:teuthology.parallel:result is None 2023-10-16T07:30:07.466 WARNING:teuthology.provision.fog.smithi022:timed out 2023-10-16T07:30:13.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:30:13.732 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T07:30:13.733 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T07:30:14.056 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-10-16T07:30:14.057 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-10-16T07:30:14.076 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-10-16T07:30:14.077 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-10-16T07:30:14.136 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-16T07:30:14.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-10-16T07:30:14.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-10-16T07:30:14.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-10-16T07:30:14.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-10-16T07:30:14.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-10-16T07:30:14.504 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-10-16T07:30:14.562 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:30:14.563 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:30:14.563 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-10-16T07:30:14.563 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-10-16T07:30:14.563 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-10-16T07:30:14.564 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:30:14.564 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:30:14.564 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-10-16T07:30:14.564 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:30:14.564 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:30:14.565 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:30:14.565 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:30:14.565 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-16T07:30:14.565 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:30:14.565 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:30:14.566 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:30:14.566 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:30:14.566 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-10-16T07:30:14.567 DEBUG:teuthology.parallel:result is None 2023-10-16T07:30:14.909 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-10-16T07:30:14.910 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:30:14.942 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-10-16T07:30:14.942 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T07:30:14.993 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:30:14.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-16T07:30:14.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:30:15.068 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-10-16T07:30:15.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-16T07:30:15.137 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-10-16T07:30:15.196 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-10-16T07:30:15.197 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-10-16T07:30:15.255 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:30:15.255 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:30:15.255 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-10-16T07:30:15.255 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-10-16T07:30:15.256 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-10-16T07:30:15.256 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:30:15.256 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:30:15.256 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-10-16T07:30:15.256 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:30:15.257 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:30:15.257 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:30:15.257 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:30:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-16T07:30:15.258 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:30:15.258 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:30:15.258 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:30:15.258 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:30:15.259 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-10-16T07:30:15.292 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-10-16T07:30:15.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-16T07:30:15.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T07:30:15.368 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-16T07:30:15.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-16T07:30:15.436 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-16T07:30:15.494 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-16T07:30:15.494 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-16T07:30:15.551 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T07:30:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T07:30:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-10-16T07:30:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-10-16T07:30:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-10-16T07:30:15.552 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-16T07:30:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T07:30:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-16T07:30:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T07:30:15.553 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T07:30:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T07:30:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T07:30:15.554 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-16T07:30:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T07:30:15.554 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T07:30:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T07:30:15.555 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T07:30:15.555 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-16T07:30:15.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:30:15.708 INFO:teuthology.dispatcher.supervisor:Running job 7428890 2023-10-16T07:30:15.708 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428890 --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428890/orig.config.yaml 2023-10-16T07:30:15.711 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428890 2023-10-16T07:30:15.712 INFO:teuthology.dispatcher.supervisor:Job PID: 11302 2023-10-16T07:30:15.712 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T07:30:54.206 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-16T07:32:15.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:34:15.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:36:15.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:38:15.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:40:16.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:42:16.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:44:16.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:46:16.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:48:16.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T07:48:16.491 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T07:48:16.675 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T07:48:16.676 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T07:48:16.747 DEBUG:teuthology.nuke:shortname: smithi022 2023-10-16T07:48:16.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:48:16.790 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-16T07:48:16.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T07:48:16.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:25:38.461578', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:48:16.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428890', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 07:25:38.459493', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T07:48:16.894 INFO:teuthology.orchestra.console.smithi022:Power off 2023-10-16T07:48:16.895 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:48:16.942 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-16T07:48:16.943 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T07:48:16.951 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-10-16T07:48:16.952 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:48:16.971 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-16T07:48:16.972 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T07:48:16.980 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-10-16T07:48:17.000 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-16T07:48:17.081 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-10-16T07:48:17.102 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-16T07:48:17.248 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-10-16T07:48:17.265 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com