2023-12-19T18:37:46.676 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T18:37:46.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:37:46.818 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff813ef3940>, signals=[15]) 2023-12-19T18:37:46.818 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-12-19T18:37:46.819 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T18:37:46.819 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-12-19T18:37:46.844 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2023-12-19T18:37:46.845 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T18:37:46.845 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-19T18:37:46.959 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10) 2023-12-19T18:37:46.985 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_9.stream (ID 10) 2023-12-19T18:37:46.997 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream 2023-12-19T18:37:47.038 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 9.stream 2023-12-19T18:37:47.339 INFO:teuthology.orchestra.console.smithi043:Power off 2023-12-19T18:37:47.339 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T18:37:47.363 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-12-19T18:37:47.363 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:47.382 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-19T18:37:47.382 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T18:37:47.391 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-19T18:37:47.403 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-19T18:37:47.403 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:47.424 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-19T18:37:47.492 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-12-19T18:37:47.525 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-19T18:37:47.593 INFO:teuthology.orchestra.console.smithi043:Power on 2023-12-19T18:37:47.593 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T18:37:47.616 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2023-12-19T18:37:47.617 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:47.627 INFO:teuthology.orchestra.console.smithi176:Power on 2023-12-19T18:37:47.627 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T18:37:47.638 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-19T18:37:47.648 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On 2023-12-19T18:37:47.648 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:47.671 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-19T18:37:51.643 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:51.673 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:51.754 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-19T18:37:51.785 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-19T18:37:55.758 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:55.785 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:37:55.869 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-19T18:37:55.971 INFO:teuthology.orchestra.console.smithi043:Power on completed 2023-12-19T18:37:55.972 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-12-19T18:37:56.072 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-12-19T18:37:56.077 INFO:teuthology.orchestra.console.smithi176:Power on completed 2023-12-19T18:37:56.178 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2023-12-19T18:40:27.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:27.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:30.198 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-19T18:40:30.198 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:40:36.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:36.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:39.281 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-19T18:40:39.282 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:40:45.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:45.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:48.373 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-19T18:40:48.374 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:40:54.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:54.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:40:57.430 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-19T18:40:57.461 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:41:03.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:03.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:06.513 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:41:06.514 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-19T18:41:12.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:12.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:15.573 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:41:21.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:24.661 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-12-19T18:41:30.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:42:12.562 WARNING:teuthology.provision.fog.smithi043:timed out 2023-12-19T18:42:18.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:42:18.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T18:42:18.855 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T18:42:19.192 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-12-19T18:42:19.192 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-12-19T18:42:19.207 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-12-19T18:42:19.208 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-12-19T18:42:19.264 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-12-19T18:42:19.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-12-19T18:42:19.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-12-19T18:42:19.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-12-19T18:42:19.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-12-19T18:42:19.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-12-19T18:42:19.616 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-12-19T18:42:19.668 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T18:42:19.669 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T18:42:19.670 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-12-19T18:42:19.671 DEBUG:teuthology.parallel:result is None 2023-12-19T18:42:30.677 WARNING:teuthology.provision.fog.smithi176:timed out 2023-12-19T18:42:36.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:42:36.972 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T18:42:36.972 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T18:42:37.305 INFO:teuthology.provision.fog.smithi176:Node is ready 2023-12-19T18:42:37.305 DEBUG:teuthology.orchestra.run.smithi176:> hostname 2023-12-19T18:42:37.320 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2023-12-19T18:42:37.320 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts 2023-12-19T18:42:37.376 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2023-12-19T18:42:37.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-19T18:42:37.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts 2023-12-19T18:42:37.505 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts 2023-12-19T18:42:37.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname 2023-12-19T18:42:37.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2023-12-19T18:42:37.709 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T18:42:37.764 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-19T18:42:37.765 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T18:42:37.765 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T18:42:37.765 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T18:42:37.765 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2023-12-19T18:42:37.765 DEBUG:teuthology.parallel:result is None 2023-12-19T18:42:37.937 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-12-19T18:42:37.938 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T18:42:37.960 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2023-12-19T18:42:37.960 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T18:42:37.978 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-12-19T18:42:37.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-19T18:42:37.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:42:38.078 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-12-19T18:42:38.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-19T18:42:38.260 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-12-19T18:42:38.316 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-12-19T18:42:38.316 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T18:42:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T18:42:38.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T18:42:38.371 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-12-19T18:42:38.394 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2023-12-19T18:42:38.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-19T18:42:38.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:42:38.479 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-12-19T18:42:38.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-12-19T18:42:38.544 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-12-19T18:42:38.599 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-12-19T18:42:38.599 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2023-12-19T18:42:38.654 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T18:42:38.655 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T18:42:38.655 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-12-19T18:42:38.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:42:38.782 INFO:teuthology.dispatcher.supervisor:Running job 7497306 2023-12-19T18:42:38.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497306 --name yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497306/orig.config.yaml 2023-12-19T18:42:38.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497306 2023-12-19T18:42:38.785 INFO:teuthology.dispatcher.supervisor:Job PID: 1610969 2023-12-19T18:42:38.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T18:44:38.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:46:39.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:48:39.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:50:39.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:52:39.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:54:39.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:56:39.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:58:40.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:00:40.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:02:40.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:04:40.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:06:40.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:08:40.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:10:41.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:12:41.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:14:41.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:16:41.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:18:41.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:18:41.941 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T19:18:42.122 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T19:18:42.122 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T19:18:42.172 DEBUG:teuthology.nuke:shortname: smithi043 2023-12-19T19:18:42.173 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T19:18:42.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:37:45.815664', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0fwNNOMGJIZz+UzGvNKHWvG+pSThohEB+qwNJE1a7ZvzbRCv04PUHgDhhRVyZkqX1l92I4uBqOdbNmqgBGAOc='} 2023-12-19T19:18:42.198 DEBUG:teuthology.nuke:shortname: smithi176 2023-12-19T19:18:42.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T19:18:42.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:37:45.817304', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnP1MRpVxMiYs1xzHyZNwD3xIboKOvcVxX/I/CubfIyKtEJhjsLJxSuDT3kvvl82zdI6Bp6b9qhZ/NebQoECjU='} 2023-12-19T19:18:42.251 INFO:teuthology.orchestra.console.smithi043:Power off 2023-12-19T19:18:42.251 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T19:18:42.274 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-12-19T19:18:42.274 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:18:42.290 INFO:teuthology.orchestra.console.smithi176:Power off 2023-12-19T19:18:42.290 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T19:18:42.300 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-19T19:18:42.314 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-12-19T19:18:42.315 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:18:42.336 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-12-19T19:18:42.401 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-12-19T19:18:42.437 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-12-19T19:18:42.548 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-12-19T19:18:42.581 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com