2023-10-05T08:24:06.152 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T08:24:06.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:24:06.302 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbae95f9670>, signals=[15]) 2023-10-05T08:24:06.303 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-10-05T08:24:06.303 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T08:24:06.304 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-05T08:24:06.330 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-10-05T08:24:06.330 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T08:24:06.330 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-05T08:24:06.331 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-10-05T08:24:06.355 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-10-05T08:24:06.404 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T08:24:06.424 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T08:24:06.444 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T08:24:06.444 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 7} 2023-10-05T08:24:06.463 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T08:24:06.463 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 7} 2023-10-05T08:24:06.491 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.4 2023-10-05T08:24:06.492 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:24:06.502 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.4 2023-10-05T08:24:06.502 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:24:06.554 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T08:24:06.558 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T08:24:06.591 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-10-05T08:24:06.594 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-10-05T08:24:06.663 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:24:06.671 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:24:06.765 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-05T08:24:06.766 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:24:06.777 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-05T08:24:06.778 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:24:06.786 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-05T08:24:06.786 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:06.798 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-05T08:24:06.798 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:06.806 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-05T08:24:06.820 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-05T08:24:06.907 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-05T08:24:06.921 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-05T08:24:07.008 INFO:teuthology.orchestra.console.smithi008:Power on 2023-10-05T08:24:07.009 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T08:24:07.022 INFO:teuthology.orchestra.console.smithi081:Power on 2023-10-05T08:24:07.022 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T08:24:07.029 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2023-10-05T08:24:07.030 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:07.044 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-10-05T08:24:07.044 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:07.053 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-05T08:24:07.067 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-05T08:24:11.054 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:11.068 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:11.163 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-05T08:24:11.175 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-05T08:24:11.275 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-10-05T08:24:11.376 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-10-05T08:24:11.377 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:24:15.166 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:24:15.274 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-05T08:24:15.375 INFO:teuthology.orchestra.console.smithi008:Power on completed 2023-10-05T08:24:15.476 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-10-05T08:24:15.476 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:24:26.462 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:24:30.555 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:24:41.546 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:24:45.626 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:24:56.631 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:25:00.694 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:25:11.702 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:25:15.758 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:25:26.764 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:25:30.824 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:25:41.833 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:25:45.902 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:25:56.910 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:26:00.982 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:26:11.983 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:26:16.062 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:26:27.066 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:26:31.130 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:26:42.143 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:26:46.210 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-05T08:26:46.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:26:46.365 ERROR:teuthology.orchestra.connection:Error authenticating with smithi008.front.sepia.ceph.com: Authentication failed. 2023-10-05T08:26:46.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T08:26:46.366 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T08:26:46.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-05T08:26:57.214 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-10-05T08:26:57.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:27:15.706 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-05T08:27:21.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:27:24.763 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-05T08:27:30.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:27:33.822 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-05T08:27:39.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:27:42.878 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-05T08:27:48.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:27:51.965 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-05T08:27:57.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:28:38.394 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-05T08:28:38.395 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi008 2023-10-05T08:28:47.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-05T08:28:47.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:28:47.790 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-05T08:28:48.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-05T08:28:48.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T08:28:48.062 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T08:28:48.076 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-10-05T08:28:48.076 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-10-05T08:28:48.130 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-10-05T08:28:48.131 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-10-05T08:28:48.185 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-10-05T08:28:48.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-10-05T08:28:48.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-10-05T08:28:48.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-10-05T08:28:48.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-10-05T08:28:48.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-10-05T08:28:48.522 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-05T08:28:48.577 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T08:28:48.578 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T08:28:48.579 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-10-05T08:28:48.580 DEBUG:teuthology.parallel:result is None 2023-10-05T08:28:57.969 WARNING:teuthology.provision.fog.smithi081:timed out 2023-10-05T08:29:03.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:29:04.235 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T08:29:04.236 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T08:29:04.474 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-10-05T08:29:04.474 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-10-05T08:29:04.529 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-10-05T08:29:04.530 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-10-05T08:29:04.585 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-10-05T08:29:04.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-05T08:29:04.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-10-05T08:29:04.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-10-05T08:29:04.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-10-05T08:29:04.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-10-05T08:29:04.915 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-05T08:29:04.970 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T08:29:04.970 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:29:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-05T08:29:04.972 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:29:04.972 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T08:29:04.972 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T08:29:04.972 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T08:29:04.972 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-10-05T08:29:04.973 DEBUG:teuthology.parallel:result is None 2023-10-05T08:29:05.121 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-10-05T08:29:05.122 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T08:29:05.151 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-10-05T08:29:05.151 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T08:29:05.177 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-10-05T08:29:05.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-05T08:29:05.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:29:05.246 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-05T08:29:05.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-05T08:29:05.316 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-05T08:29:05.373 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-05T08:29:05.373 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-10-05T08:29:05.431 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T08:29:05.432 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T08:29:05.433 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-05T08:29:05.451 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-10-05T08:29:05.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-05T08:29:05.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T08:29:05.520 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-05T08:29:05.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-05T08:29:05.589 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-05T08:29:05.643 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-05T08:29:05.644 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-05T08:29:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T08:29:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T08:29:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-05T08:29:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-05T08:29:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T08:29:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T08:29:05.700 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T08:29:05.700 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-05T08:29:05.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:29:05.807 INFO:teuthology.dispatcher.supervisor:Running job 7411146 2023-10-05T08:29:05.807 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411146 --name yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411146/orig.config.yaml 2023-10-05T08:29:05.811 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411146 2023-10-05T08:29:05.812 INFO:teuthology.dispatcher.supervisor:Job PID: 3609425 2023-10-05T08:29:05.812 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-05T08:31:05.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:33:06.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:35:06.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:37:06.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:39:06.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:41:06.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:43:06.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:45:07.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:47:07.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T08:47:07.294 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-05T08:47:07.393 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-05T08:47:07.393 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T08:47:07.440 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-05T08:47:07.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T08:47:07.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:24:05.322230', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhRkPz5dha/3RffBPIruHyrxTQbuDBEWl/Gd8KgVckcsmw7bok79JqShbiMxWdMHRZABCzA1Z2MrmnbDCsdqOs='} 2023-10-05T08:47:07.467 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-05T08:47:07.467 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T08:47:07.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:24:05.320724', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGDqd6Yp43dw0b1cZa2h47GAMFOfyPZrvWpzFW0lvO/1/EfxhOLgQNSDqM0IOS0qpSR1+YMZZbzWt3TBA2o8Mk8='} 2023-10-05T08:47:07.516 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-05T08:47:07.517 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:47:07.538 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-05T08:47:07.538 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:47:07.553 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-05T08:47:07.553 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T08:47:07.560 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-05T08:47:07.572 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-05T08:47:07.573 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T08:47:07.592 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-05T08:47:07.661 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-05T08:47:07.693 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-05T08:47:07.819 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-10-05T08:47:07.832 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com