2024-04-10T07:53:03.833 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-10T07:53:03.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T07:53:03.990 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad33322c10>, signals=[15]) 2024-04-10T07:53:03.990 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-04-10T07:53:03.991 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T07:53:03.991 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-04-10T07:53:04.019 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2024-04-10T07:53:04.020 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T07:53:04.020 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-04-10T07:53:04.152 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T07:53:04.167 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T07:53:04.204 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2024-04-10T07:53:04.218 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream 2024-04-10T07:53:04.475 INFO:teuthology.orchestra.console.smithi094:Power off 2024-04-10T07:53:04.475 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T07:53:04.490 INFO:teuthology.orchestra.console.smithi033:Power off 2024-04-10T07:53:04.490 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T07:53:04.500 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-04-10T07:53:04.501 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:04.514 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-04-10T07:53:04.515 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:04.524 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-10T07:53:04.538 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-04-10T07:53:08.527 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:08.539 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:08.636 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-10T07:53:08.647 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-04-10T07:53:12.638 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:12.649 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:12.748 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-10T07:53:12.762 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-04-10T07:53:12.862 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-04-10T07:53:12.963 INFO:teuthology.orchestra.console.smithi033:Power on 2024-04-10T07:53:12.963 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T07:53:12.984 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-04-10T07:53:12.985 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:13.006 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-04-10T07:53:16.750 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:16.859 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-04-10T07:53:16.960 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-04-10T07:53:17.008 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:17.061 INFO:teuthology.orchestra.console.smithi094:Power on 2024-04-10T07:53:17.061 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T07:53:17.083 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2024-04-10T07:53:17.083 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:17.104 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-04-10T07:53:17.116 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-04-10T07:53:21.106 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:21.118 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T07:53:21.216 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-10T07:53:21.240 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-04-10T07:53:21.317 INFO:teuthology.orchestra.console.smithi094:Power on completed 2024-04-10T07:53:21.341 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-04-10T07:53:21.418 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2024-04-10T07:53:21.443 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-04-10T07:55:37.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:55:40.414 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:55:46.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:55:49.506 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:55:52.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:55:52.603 ERROR:teuthology.orchestra.connection:Error authenticating with smithi094.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-10T07:55:55.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:55:58.558 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:56:04.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:56:07.614 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:56:13.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:56:16.670 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:56:22.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:56:25.726 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-04-10T07:56:31.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:56:56.607 WARNING:teuthology.provision.fog.smithi094:timed out 2024-04-10T07:57:02.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:05.666 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-04-10T07:57:11.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:14.721 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-04-10T07:57:20.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:23.774 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-04-10T07:57:29.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:31.731 WARNING:teuthology.provision.fog.smithi033:timed out 2024-04-10T07:57:32.830 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-04-10T07:57:37.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:37.987 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T07:57:37.987 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T07:57:38.335 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-04-10T07:57:38.335 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-04-10T07:57:38.350 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-04-10T07:57:38.350 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-04-10T07:57:38.406 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-04-10T07:57:38.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-04-10T07:57:38.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-04-10T07:57:38.553 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-04-10T07:57:38.625 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-04-10T07:57:38.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-04-10T07:57:38.767 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-04-10T07:57:38.821 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-04-10T07:57:38.821 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-04-10T07:57:38.821 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T07:57:38.822 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T07:57:38.823 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-04-10T07:57:38.824 DEBUG:teuthology.parallel:result is None 2024-04-10T07:57:38.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:39.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T07:57:39.240 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T07:57:54.567 INFO:teuthology.provision.fog.smithi094:Node is ready 2024-04-10T07:57:54.568 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2024-04-10T07:57:54.585 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2024-04-10T07:57:54.585 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2024-04-10T07:57:54.643 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2024-04-10T07:57:54.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2024-04-10T07:57:54.753 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2024-04-10T07:57:54.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2024-04-10T07:57:54.853 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2024-04-10T07:57:54.922 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2024-04-10T07:57:54.990 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-04-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T07:57:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T07:57:55.047 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2024-04-10T07:57:55.048 DEBUG:teuthology.parallel:result is None 2024-04-10T07:57:55.222 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-04-10T07:57:55.222 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T07:57:55.247 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2024-04-10T07:57:55.247 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T07:57:55.264 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-04-10T07:57:55.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-10T07:57:55.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:55.369 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-04-10T07:57:55.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-10T07:57:55.549 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-04-10T07:57:55.603 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-04-10T07:57:55.604 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-04-10T07:57:55.658 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T07:57:55.659 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T07:57:55.660 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-04-10T07:57:55.680 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2024-04-10T07:57:55.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-10T07:57:55.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T07:57:55.766 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-10T07:57:55.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-10T07:57:55.834 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-04-10T07:57:55.890 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-04-10T07:57:55.890 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-04-10T07:57:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T07:57:55.948 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T07:57:55.948 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T07:57:55.948 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-04-10T07:57:55.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T07:57:56.076 INFO:teuthology.dispatcher.supervisor:Running job 7646308 2024-04-10T07:57:56.076 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646308 --name teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646308/orig.config.yaml 2024-04-10T07:57:56.079 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646308 2024-04-10T07:57:56.080 INFO:teuthology.dispatcher.supervisor:Job PID: 782410 2024-04-10T07:57:56.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-10T07:59:56.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:01:56.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:03:56.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:05:56.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:07:56.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:09:56.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:11:56.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:13:56.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:15:56.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:17:56.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:19:56.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:21:56.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:23:57.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:25:57.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:27:57.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:29:57.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:31:57.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:33:57.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:35:57.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:37:57.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:39:57.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:41:57.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T08:41:57.740 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1