2024-01-19T04:41:27.315 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T04:41:27.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:41:27.573 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc76c0abc10>, signals=[15]) 2024-01-19T04:41:27.574 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-01-19T04:41:27.574 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T04:41:27.574 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-19T04:41:27.592 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2024-01-19T04:41:27.593 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T04:41:27.593 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-01-19T04:41:27.709 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2024-01-19T04:41:27.737 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2024-01-19T04:41:27.754 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2024-01-19T04:41:27.789 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2024-01-19T04:41:28.053 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-19T04:41:28.053 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T04:41:28.067 INFO:teuthology.orchestra.console.smithi174:Power off 2024-01-19T04:41:28.068 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T04:41:28.077 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-19T04:41:28.077 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:28.090 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-01-19T04:41:28.090 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:28.099 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-19T04:41:28.112 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-01-19T04:41:32.104 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:32.113 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:32.213 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-19T04:41:32.221 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-01-19T04:41:36.219 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:36.226 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:36.328 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-19T04:41:36.334 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-01-19T04:41:40.333 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:40.340 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:40.442 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-19T04:41:40.449 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-01-19T04:41:40.543 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-19T04:41:40.549 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-01-19T04:41:40.644 INFO:teuthology.orchestra.console.smithi033:Power on 2024-01-19T04:41:40.644 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T04:41:40.651 INFO:teuthology.orchestra.console.smithi174:Power on 2024-01-19T04:41:40.651 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T04:41:40.665 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-01-19T04:41:40.665 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:40.673 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2024-01-19T04:41:40.673 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:40.685 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-19T04:41:40.692 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-01-19T04:41:44.687 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:44.693 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:41:44.796 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-19T04:41:44.801 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-01-19T04:41:44.897 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-01-19T04:41:44.902 INFO:teuthology.orchestra.console.smithi174:Power on completed 2024-01-19T04:41:44.998 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-01-19T04:41:45.003 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2024-01-19T04:44:00.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:00.804 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-19T04:44:15.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:34.236 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-01-19T04:44:39.356 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-19T04:44:40.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:43.292 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-01-19T04:44:45.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:48.416 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-19T04:44:49.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:52.348 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-01-19T04:44:54.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:44:58.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:45:01.404 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-01-19T04:45:07.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:45:54.419 WARNING:teuthology.provision.fog.smithi033:timed out 2024-01-19T04:46:00.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:46:00.700 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T04:46:00.701 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T04:46:01.040 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-01-19T04:46:01.040 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-01-19T04:46:01.056 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-01-19T04:46:01.056 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-01-19T04:46:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-01-19T04:46:01.113 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-19T04:46:01.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-01-19T04:46:01.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-01-19T04:46:01.348 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-01-19T04:46:01.421 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-19T04:46:01.494 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-19T04:46:01.552 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-01-19T04:46:01.552 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T04:46:01.553 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-19T04:46:01.554 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-19T04:46:01.554 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-01-19T04:46:01.556 DEBUG:teuthology.parallel:result is None 2024-01-19T04:46:07.408 WARNING:teuthology.provision.fog.smithi174:timed out 2024-01-19T04:46:13.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:46:13.652 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T04:46:13.653 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T04:46:14.001 INFO:teuthology.provision.fog.smithi174:Node is ready 2024-01-19T04:46:14.001 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2024-01-19T04:46:14.016 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2024-01-19T04:46:14.016 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2024-01-19T04:46:14.072 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2024-01-19T04:46:14.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-01-19T04:46:14.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2024-01-19T04:46:14.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2024-01-19T04:46:14.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2024-01-19T04:46:14.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-01-19T04:46:14.413 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-01-19T04:46:14.468 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-01-19T04:46:14.469 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-19T04:46:14.469 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-01-19T04:46:14.469 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T04:46:14.469 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-19T04:46:14.469 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-19T04:46:14.469 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2024-01-19T04:46:14.470 DEBUG:teuthology.parallel:result is None 2024-01-19T04:46:14.645 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-01-19T04:46:14.646 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T04:46:14.674 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2024-01-19T04:46:14.674 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T04:46:14.693 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-01-19T04:46:14.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-19T04:46:14.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:46:14.807 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-01-19T04:46:14.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-19T04:46:14.990 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-01-19T04:46:15.045 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-01-19T04:46:15.045 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-19T04:46:15.100 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-01-19T04:46:15.100 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-01-19T04:46:15.100 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-19T04:46:15.101 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-19T04:46:15.102 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-19T04:46:15.124 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2024-01-19T04:46:15.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-01-19T04:46:15.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:46:15.208 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-01-19T04:46:15.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-01-19T04:46:15.274 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-01-19T04:46:15.328 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-01-19T04:46:15.329 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-01-19T04:46:15.382 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-01-19T04:46:15.382 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-01-19T04:46:15.382 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-19T04:46:15.383 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-19T04:46:15.384 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-01-19T04:46:15.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:46:15.501 INFO:teuthology.dispatcher.supervisor:Running job 7521040 2024-01-19T04:46:15.501 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521040 --name yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521040/orig.config.yaml 2024-01-19T04:46:15.503 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521040 2024-01-19T04:46:15.504 INFO:teuthology.dispatcher.supervisor:Job PID: 410261 2024-01-19T04:46:15.504 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-19T04:48:15.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:50:15.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:52:15.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:54:15.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:56:15.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:58:15.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:00:15.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:02:16.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:04:16.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:06:16.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:08:16.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:10:16.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:12:16.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:14:16.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:16:16.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:18:16.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:20:16.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:22:16.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:24:16.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:26:16.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:28:16.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:30:17.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:32:17.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:34:17.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:36:17.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:38:17.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:40:17.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:42:17.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:44:17.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:46:17.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:48:17.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:50:17.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:50:17.794 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-19T05:50:17.991 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-19T05:50:17.991 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T05:50:18.034 DEBUG:teuthology.nuke:shortname: smithi033 2024-01-19T05:50:18.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:50:18.055 DEBUG:teuthology.nuke:shortname: smithi174 2024-01-19T05:50:18.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:50:18.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:41:26.322042', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHf9sKbuaueZ5Ch0uvSHox1mqKX+B9cpeNzigSH0NKNGblG084mbp6lA4793mPrklpMGIPBC7VvjV68LtKovNi8='} 2024-01-19T05:50:18.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:41:26.323519', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKeOahTbd3gpF5Zahtp8mevT1r7wW9mzQtWHNfKuUzLXJPTF9yPmRtFvj2hNvJ+JPb5YX/IEfOdpwhUTDfd2AMs='} 2024-01-19T05:50:18.105 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-19T05:50:18.105 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:50:18.128 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-19T05:50:18.129 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:50:18.143 INFO:teuthology.orchestra.console.smithi174:Power off 2024-01-19T05:50:18.144 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:50:18.151 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-19T05:50:18.164 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-01-19T05:50:18.164 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:50:18.188 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-01-19T05:50:18.252 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-19T05:50:18.289 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-01-19T05:50:18.408 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2024-01-19T05:50:18.440 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com