2024-03-27T06:22:52.394 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T06:22:52.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:22:52.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e88b69c10>, signals=[15]) 2024-03-27T06:22:52.548 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2024-03-27T06:22:52.549 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2024-03-27T06:22:52.549 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-03-27T06:22:52.574 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging 2024-03-27T06:22:52.574 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server 2024-03-27T06:22:52.574 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-03-27T06:22:52.708 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10) 2024-03-27T06:22:52.719 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_9.stream (ID 10) 2024-03-27T06:22:52.752 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream 2024-03-27T06:22:52.763 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 9.stream 2024-03-27T06:22:53.026 INFO:teuthology.orchestra.console.smithi165:Power off 2024-03-27T06:22:53.026 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T06:22:53.038 INFO:teuthology.orchestra.console.smithi078:Power off 2024-03-27T06:22:53.038 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T06:22:53.047 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off 2024-03-27T06:22:53.047 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:22:53.058 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-03-27T06:22:53.059 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:22:53.069 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-27T06:22:53.083 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-27T06:22:57.074 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:22:57.084 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:22:57.183 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-27T06:22:57.193 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-27T06:23:01.187 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:01.194 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:01.297 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-27T06:23:01.303 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-03-27T06:23:01.404 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-03-27T06:23:01.505 INFO:teuthology.orchestra.console.smithi078:Power on 2024-03-27T06:23:01.505 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-27T06:23:01.530 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2024-03-27T06:23:01.531 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:01.553 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-03-27T06:23:05.300 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:05.409 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-27T06:23:05.510 INFO:teuthology.orchestra.console.smithi165:Power off completed 2024-03-27T06:23:05.554 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:05.611 INFO:teuthology.orchestra.console.smithi165:Power on 2024-03-27T06:23:05.611 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-27T06:23:05.637 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On 2024-03-27T06:23:05.637 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:05.663 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-03-27T06:23:05.675 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-27T06:23:05.764 INFO:teuthology.orchestra.console.smithi078:Power on completed 2024-03-27T06:23:05.864 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2024-03-27T06:23:09.678 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T06:23:09.787 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-27T06:23:09.888 INFO:teuthology.orchestra.console.smithi165:Power on completed 2024-03-27T06:23:09.989 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2024-03-27T06:25:36.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:25:36.860 ERROR:teuthology.orchestra.connection:Error authenticating with smithi078.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-27T06:25:55.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:25:58.846 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:04.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:07.902 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:13.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:16.958 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:22.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:26.018 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:32.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:35.070 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:40.863 WARNING:teuthology.provision.fog.smithi078:timed out 2024-03-27T06:26:41.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:44.126 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:46.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:49.918 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-03-27T06:26:50.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:53.186 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:26:55.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:26:58.978 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-03-27T06:26:59.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:27:02.242 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-27T06:27:04.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:27:08.030 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-03-27T06:27:08.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:27:14.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:27:17.086 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-03-27T06:27:23.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:27:23.438 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-27T06:27:23.439 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-27T06:27:38.868 INFO:teuthology.provision.fog.smithi078:Node is ready 2024-03-27T06:27:38.868 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2024-03-27T06:27:38.886 INFO:teuthology.orchestra.run.smithi078.stdout:smithi046 2024-03-27T06:27:38.886 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi046 /etc/hosts 2024-03-27T06:27:38.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T06:27:38.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi046/smithi078/g' /etc/hostname 2024-03-27T06:27:39.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2024-03-27T06:27:39.108 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-03-27T06:27:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-03-27T06:27:39.163 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T06:27:39.164 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T06:27:39.165 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2024-03-27T06:27:39.167 DEBUG:teuthology.parallel:result is None 2024-03-27T06:28:08.247 WARNING:teuthology.provision.fog.smithi165:timed out 2024-03-27T06:28:14.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:28:14.443 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-27T06:28:14.443 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-27T06:28:14.775 INFO:teuthology.provision.fog.smithi165:Node is ready 2024-03-27T06:28:14.776 DEBUG:teuthology.orchestra.run.smithi165:> hostname 2024-03-27T06:28:14.790 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2024-03-27T06:28:14.791 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts 2024-03-27T06:28:14.846 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2024-03-27T06:28:14.846 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-03-27T06:28:14.951 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts 2024-03-27T06:28:14.978 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts 2024-03-27T06:28:15.044 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname 2024-03-27T06:28:15.112 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-03-27T06:28:15.178 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-03-27T06:28:15.232 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T06:28:15.233 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T06:28:15.233 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2024-03-27T06:28:15.234 DEBUG:teuthology.parallel:result is None 2024-03-27T06:28:15.400 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2024-03-27T06:28:15.400 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-27T06:28:15.429 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2024-03-27T06:28:15.430 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-27T06:28:15.455 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2024-03-27T06:28:15.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-27T06:28:15.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:28:15.542 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-03-27T06:28:15.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-03-27T06:28:15.712 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-03-27T06:28:15.767 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-03-27T06:28:15.767 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-03-27T06:28:15.822 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-03-27T06:28:15.822 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-03-27T06:28:15.822 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-03-27T06:28:15.822 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T06:28:15.823 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T06:28:15.824 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-03-27T06:28:15.846 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2024-03-27T06:28:15.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-27T06:28:15.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T06:28:15.933 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-03-27T06:28:16.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-27T06:28:16.000 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-03-27T06:28:16.055 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-03-27T06:28:16.056 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-03-27T06:28:16.109 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-03-27T06:28:16.110 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T06:28:16.111 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T06:28:16.111 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T06:28:16.111 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-03-27T06:28:16.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:28:16.225 INFO:teuthology.dispatcher.supervisor:Running job 7625607 2024-03-27T06:28:16.225 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625607 --name rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625607/orig.config.yaml 2024-03-27T06:28:16.228 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625607 2024-03-27T06:28:16.229 INFO:teuthology.dispatcher.supervisor:Job PID: 2837467 2024-03-27T06:28:16.229 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-27T06:30:16.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:32:16.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:34:16.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:36:16.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:38:16.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:40:16.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:42:16.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:44:16.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:46:16.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:48:16.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:50:16.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:52:17.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:54:17.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:56:17.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T06:58:17.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:00:17.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:02:17.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:04:17.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:06:17.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:08:17.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:10:17.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:12:17.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:14:17.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:16:17.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:18:18.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:20:18.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:20:18.237 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1