2024-03-26T08:16:20.681 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T08:16:20.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:16:20.864 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f168ed13c10>, signals=[15]) 2024-03-26T08:16:20.864 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-03-26T08:16:20.865 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T08:16:20.865 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-26T08:16:20.886 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2024-03-26T08:16:20.886 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T08:16:20.886 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-03-26T08:16:21.006 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T08:16:21.013 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T08:16:21.056 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2024-03-26T08:16:21.059 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream 2024-03-26T08:16:21.322 INFO:teuthology.orchestra.console.smithi164:Power off 2024-03-26T08:16:21.323 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T08:16:21.338 INFO:teuthology.orchestra.console.smithi059:Power off 2024-03-26T08:16:21.338 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T08:16:21.348 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-03-26T08:16:21.348 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:21.362 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-03-26T08:16:21.362 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:21.372 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-26T08:16:21.386 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-26T08:16:21.473 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-03-26T08:16:21.487 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-03-26T08:16:21.574 INFO:teuthology.orchestra.console.smithi164:Power on 2024-03-26T08:16:21.574 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T08:16:21.589 INFO:teuthology.orchestra.console.smithi059:Power on 2024-03-26T08:16:21.589 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T08:16:21.597 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-03-26T08:16:21.597 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:21.611 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-03-26T08:16:21.611 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:21.632 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-26T08:16:21.652 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-26T08:16:25.634 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:25.653 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:25.744 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-26T08:16:25.762 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-26T08:16:29.746 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:29.763 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T08:16:29.856 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-26T08:16:29.874 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-26T08:16:29.958 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-03-26T08:16:29.975 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-03-26T08:16:30.059 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-03-26T08:16:30.076 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2024-03-26T08:19:01.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:04.478 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-26T08:19:10.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:13.537 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-26T08:19:16.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:19.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:19.582 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:19:22.622 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-26T08:19:25.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:28.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:28.638 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:19:31.682 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-26T08:19:34.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:37.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:37.694 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:19:40.766 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-26T08:19:43.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:46.750 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:19:46.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:52.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:19:55.806 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:01.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:04.894 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:10.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:13.950 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:19.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:30.111 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:39.166 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:45.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:46.771 WARNING:teuthology.provision.fog.smithi059:timed out 2024-03-26T08:20:48.222 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-26T08:20:52.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:52.980 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T08:20:52.980 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T08:20:53.312 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-03-26T08:20:53.313 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-03-26T08:20:53.328 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-03-26T08:20:53.328 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-03-26T08:20:53.384 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-03-26T08:20:53.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-03-26T08:20:53.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-03-26T08:20:53.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-03-26T08:20:53.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-03-26T08:20:53.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-03-26T08:20:53.736 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-26T08:20:53.790 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-26T08:20:53.790 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-26T08:20:53.790 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-26T08:20:53.790 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T08:20:53.791 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T08:20:53.792 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-03-26T08:20:53.793 DEBUG:teuthology.parallel:result is None 2024-03-26T08:20:54.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:20:56.853 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T08:20:56.853 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T08:21:17.236 INFO:teuthology.provision.fog.smithi164:Node is ready 2024-03-26T08:21:17.236 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2024-03-26T08:21:17.296 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2024-03-26T08:21:17.296 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2024-03-26T08:21:17.354 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2024-03-26T08:21:17.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-03-26T08:21:17.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2024-03-26T08:21:17.509 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2024-03-26T08:21:17.580 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2024-03-26T08:21:17.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-03-26T08:21:17.717 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-03-26T08:21:17.773 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-03-26T08:21:17.774 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T08:21:17.774 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-03-26T08:21:17.774 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T08:21:17.774 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T08:21:17.774 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T08:21:17.774 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2024-03-26T08:21:17.775 DEBUG:teuthology.parallel:result is None 2024-03-26T08:21:17.971 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-03-26T08:21:17.971 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T08:21:17.992 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2024-03-26T08:21:17.992 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T08:21:18.010 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-03-26T08:21:18.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-26T08:21:18.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:21:18.115 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-26T08:21:18.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-26T08:21:18.298 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-03-26T08:21:18.353 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-03-26T08:21:18.353 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-26T08:21:18.409 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-26T08:21:18.410 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-26T08:21:18.410 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-26T08:21:18.410 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-26T08:21:18.410 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-26T08:21:18.411 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-26T08:21:18.411 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T08:21:18.411 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-26T08:21:18.411 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-26T08:21:18.411 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T08:21:18.412 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-26T08:21:18.412 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T08:21:18.412 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T08:21:18.412 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T08:21:18.413 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-26T08:21:18.434 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2024-03-26T08:21:18.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-26T08:21:18.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T08:21:18.535 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-03-26T08:21:18.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-26T08:21:18.607 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-03-26T08:21:18.664 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-03-26T08:21:18.664 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-03-26T08:21:18.720 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T08:21:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T08:21:18.722 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-03-26T08:21:18.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:21:18.852 INFO:teuthology.dispatcher.supervisor:Running job 7622870 2024-03-26T08:21:18.853 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7622870 --name mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7622870/orig.config.yaml 2024-03-26T08:21:18.857 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-26_07:59:35-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7622870 2024-03-26T08:21:18.858 INFO:teuthology.dispatcher.supervisor:Job PID: 1295558 2024-03-26T08:21:18.858 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-26T08:23:18.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:25:19.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:27:19.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:29:19.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:31:19.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:33:19.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:35:19.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:37:20.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:39:20.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:41:20.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:43:20.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:45:20.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:47:20.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:49:21.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:51:21.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:53:21.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:55:21.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:57:21.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T08:59:22.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:01:22.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:03:22.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:05:22.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:07:22.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:09:22.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T09:09:22.924 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1