2023-12-13T01:09:26.372 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T01:09:26.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:09:26.516 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe59d537940>, signals=[15]) 2023-12-13T01:09:26.517 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-12-13T01:09:26.517 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T01:09:26.517 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-13T01:09:26.564 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-12-13T01:09:26.565 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T01:09:26.565 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-12-13T01:09:26.705 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_9.stream (ID 10) 2023-12-13T01:09:26.709 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_9.stream (ID 10) 2023-12-13T01:09:26.755 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 9.stream 2023-12-13T01:09:26.758 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 9.stream 2023-12-13T01:09:27.123 INFO:teuthology.orchestra.console.smithi155:Power off 2023-12-13T01:09:27.124 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:09:27.136 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-13T01:09:27.137 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:09:27.145 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-12-13T01:09:27.146 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:27.158 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-13T01:09:27.158 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:27.170 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-12-13T01:09:27.178 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-13T01:09:27.271 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-12-13T01:09:27.279 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-13T01:09:27.372 INFO:teuthology.orchestra.console.smithi155:Power on 2023-12-13T01:09:27.373 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T01:09:27.380 INFO:teuthology.orchestra.console.smithi116:Power on 2023-12-13T01:09:27.381 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T01:09:27.397 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-12-13T01:09:27.398 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:27.406 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-12-13T01:09:27.406 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:27.418 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-12-13T01:09:27.426 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-13T01:09:31.422 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:31.430 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:31.532 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-12-13T01:09:31.538 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-13T01:09:35.536 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:35.543 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:09:35.645 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-12-13T01:09:35.652 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-13T01:09:35.746 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-12-13T01:09:35.753 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-12-13T01:09:35.847 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-12-13T01:09:35.854 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-12-13T01:12:21.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:21.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:24.962 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:12:24.963 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:12:30.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:30.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:34.050 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:12:34.050 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:12:40.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:40.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:43.106 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:12:43.106 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:12:49.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:49.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:52.162 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:12:52.163 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:12:58.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:12:58.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:01.218 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:13:01.254 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:13:07.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:07.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:10.274 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:13:10.310 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-12-13T01:13:16.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:16.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:34.822 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:13:40.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:43.906 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:13:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:52.962 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-13T01:13:58.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:13:59.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T01:13:59.213 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T01:14:14.656 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-12-13T01:14:14.656 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-12-13T01:14:14.714 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-12-13T01:14:14.714 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-12-13T01:14:14.771 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-12-13T01:14:14.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-13T01:14:14.882 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-12-13T01:14:14.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-12-13T01:14:14.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-12-13T01:14:15.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-13T01:14:15.116 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-13T01:14:15.171 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-13T01:14:15.171 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-12-13T01:14:15.171 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-13T01:14:15.171 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-13T01:14:15.172 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-13T01:14:15.173 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:14:15.173 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-13T01:14:15.173 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T01:14:15.174 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-12-13T01:14:15.175 DEBUG:teuthology.parallel:result is None 2023-12-13T01:14:16.314 WARNING:teuthology.provision.fog.smithi155:timed out 2023-12-13T01:14:22.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:14:22.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T01:14:22.643 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T01:14:22.979 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-12-13T01:14:22.979 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-12-13T01:14:22.993 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-12-13T01:14:22.994 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-12-13T01:14:23.049 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-12-13T01:14:23.049 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-12-13T01:14:23.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-12-13T01:14:23.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-12-13T01:14:23.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-12-13T01:14:23.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-12-13T01:14:23.396 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-12-13T01:14:23.451 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-12-13T01:14:23.452 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-13T01:14:23.452 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-12-13T01:14:23.452 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:14:23.452 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-13T01:14:23.452 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T01:14:23.452 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-12-13T01:14:23.453 DEBUG:teuthology.parallel:result is None 2023-12-13T01:14:23.620 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-12-13T01:14:23.621 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T01:14:23.645 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-12-13T01:14:23.645 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T01:14:23.671 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-12-13T01:14:23.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-13T01:14:23.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:14:23.760 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-12-13T01:14:23.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-13T01:14:23.834 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-12-13T01:14:23.894 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-12-13T01:14:23.894 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-13T01:14:23.953 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-13T01:14:23.954 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T01:14:23.955 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-13T01:14:23.978 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-12-13T01:14:23.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-13T01:14:23.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:14:24.062 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-12-13T01:14:24.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-13T01:14:24.128 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-12-13T01:14:24.183 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-12-13T01:14:24.183 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-12-13T01:14:24.238 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-12-13T01:14:24.239 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-13T01:14:24.239 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-12-13T01:14:24.239 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:14:24.239 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-13T01:14:24.239 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T01:14:24.239 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-12-13T01:14:24.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:14:24.358 INFO:teuthology.dispatcher.supervisor:Running job 7489325 2023-12-13T01:14:24.359 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489325 --name yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} -- /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489325/orig.config.yaml 2023-12-13T01:14:24.363 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489325 2023-12-13T01:14:24.363 INFO:teuthology.dispatcher.supervisor:Job PID: 655711 2023-12-13T01:14:24.363 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T01:16:24.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:18:24.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:20:24.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:22:24.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:24:25.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:26:25.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:28:25.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:30:25.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:32:25.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:34:26.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:36:26.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:38:26.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:40:26.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:42:26.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:44:26.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:46:27.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:48:27.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:50:27.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:52:27.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:54:27.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:56:27.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:56:27.924 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T01:56:28.169 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T01:56:28.169 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T01:56:28.217 DEBUG:teuthology.nuke:shortname: smithi116 2023-12-13T01:56:28.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T01:56:28.238 DEBUG:teuthology.nuke:shortname: smithi155 2023-12-13T01:56:28.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T01:56:28.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489325', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:09:25.523219', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWn5/nPA2325zocsw3xNjfpnodkZNjYYrQNJ5Fs4SZ7n3ph5BocdjTqP6TGgyavjNFApoNKYE+wMGGLifOGX2M='} 2023-12-13T01:56:28.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489325', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:09:25.521379', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNl+ndEtQuOlT7ucg8TakuPDgwc6TUgM1NA2B+js70kWB2N7SWksQ5kzRom27WYzDO6BhoQkmosCLjegTlryPzM='} 2023-12-13T01:56:28.295 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-13T01:56:28.295 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:56:28.312 INFO:teuthology.orchestra.console.smithi155:Power off 2023-12-13T01:56:28.312 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:56:28.321 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-13T01:56:28.321 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:56:28.335 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-12-13T01:56:28.335 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:56:28.344 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-13T01:56:28.355 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-12-13T01:56:28.446 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-13T01:56:28.456 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-12-13T01:56:28.597 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-12-13T01:56:28.606 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com