2024-02-28T19:24:31.501 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T19:24:31.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:24:31.644 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f91beec2c10>, signals=[15]) 2024-02-28T19:24:31.645 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2024-02-28T19:24:31.645 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T19:24:31.645 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-02-28T19:24:31.671 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging 2024-02-28T19:24:31.671 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T19:24:31.671 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-02-28T19:24:31.789 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_8.stream (ID 3) 2024-02-28T19:24:31.816 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_8.stream (ID 3) 2024-02-28T19:24:31.842 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream 2024-02-28T19:24:31.859 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream 2024-02-28T19:24:32.077 INFO:teuthology.orchestra.console.smithi111:Power off 2024-02-28T19:24:32.077 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T19:24:32.093 INFO:teuthology.orchestra.console.smithi165:Power off 2024-02-28T19:24:32.093 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T19:24:32.103 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-02-28T19:24:32.104 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:32.117 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off 2024-02-28T19:24:32.117 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:32.127 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-28T19:24:32.139 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-02-28T19:24:36.132 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:36.139 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:36.242 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-28T19:24:36.249 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-02-28T19:24:40.247 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:40.254 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:40.357 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-02-28T19:24:40.363 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-02-28T19:24:40.458 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-02-28T19:24:40.464 INFO:teuthology.orchestra.console.smithi165:Power off completed 2024-02-28T19:24:40.559 INFO:teuthology.orchestra.console.smithi111:Power on 2024-02-28T19:24:40.560 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T19:24:40.567 INFO:teuthology.orchestra.console.smithi165:Power on 2024-02-28T19:24:40.567 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T19:24:40.581 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-02-28T19:24:40.581 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:40.590 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On 2024-02-28T19:24:40.591 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:40.607 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-02-28T19:24:40.611 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-02-28T19:24:44.612 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:44.619 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:44.724 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-02-28T19:24:44.728 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-02-28T19:24:48.728 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:48.735 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:24:48.838 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-28T19:24:48.845 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-02-28T19:24:48.939 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-02-28T19:24:48.946 INFO:teuthology.orchestra.console.smithi165:Power on completed 2024-02-28T19:24:49.040 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2024-02-28T19:24:49.047 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2024-02-28T19:27:35.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:27:35.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:27:35.194 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-28T19:27:38.108 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:27:44.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:27:47.164 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:27:53.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:27:56.220 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:02.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:05.280 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:14.364 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:20.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:23.420 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:29.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:32.476 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:38.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:39.197 WARNING:teuthology.provision.fog.smithi111:timed out 2024-02-28T19:28:41.532 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-02-28T19:28:45.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:47.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:28:48.252 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-28T19:28:54.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:12.764 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-28T19:29:18.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:21.824 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-28T19:29:27.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:28.105 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T19:29:28.106 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T19:29:47.536 WARNING:teuthology.provision.fog.smithi165:timed out 2024-02-28T19:29:53.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:53.781 INFO:teuthology.provision.fog.smithi111:Node is ready 2024-02-28T19:29:53.782 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2024-02-28T19:29:53.805 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2024-02-28T19:29:53.805 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2024-02-28T19:29:53.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T19:29:53.832 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T19:29:53.866 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2024-02-28T19:29:53.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-02-28T19:29:53.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2024-02-28T19:29:54.029 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2024-02-28T19:29:54.067 INFO:teuthology.provision.fog.smithi165:Node is ready 2024-02-28T19:29:54.067 DEBUG:teuthology.orchestra.run.smithi165:> hostname 2024-02-28T19:29:54.086 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2024-02-28T19:29:54.086 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts 2024-02-28T19:29:54.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2024-02-28T19:29:54.144 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2024-02-28T19:29:54.145 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-02-28T19:29:54.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-02-28T19:29:54.236 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-02-28T19:29:54.252 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts 2024-02-28T19:29:54.280 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts 2024-02-28T19:29:54.293 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-02-28T19:29:54.293 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:29:54.294 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:29:54.295 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2024-02-28T19:29:54.296 DEBUG:teuthology.parallel:result is None 2024-02-28T19:29:54.349 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname 2024-02-28T19:29:54.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-02-28T19:29:54.483 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-02-28T19:29:54.540 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:29:54.541 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:29:54.541 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2024-02-28T19:29:54.542 DEBUG:teuthology.parallel:result is None 2024-02-28T19:29:54.691 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2024-02-28T19:29:54.692 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T19:29:54.722 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2024-02-28T19:29:54.722 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T19:29:54.747 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2024-02-28T19:29:54.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-28T19:29:54.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:54.820 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-02-28T19:29:54.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-28T19:29:54.892 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-02-28T19:29:54.950 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-02-28T19:29:54.951 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-02-28T19:29:55.009 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:29:55.010 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:29:55.011 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-02-28T19:29:55.030 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2024-02-28T19:29:55.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-02-28T19:29:55.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:29:55.099 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-02-28T19:29:55.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-02-28T19:29:55.168 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-02-28T19:29:55.227 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-02-28T19:29:55.227 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-02-28T19:29:55.284 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-02-28T19:29:55.284 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:29:55.285 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:29:55.286 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-02-28T19:29:55.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:29:55.400 INFO:teuthology.dispatcher.supervisor:Running job 7576260 2024-02-28T19:29:55.400 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576260 --name pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576260/orig.config.yaml 2024-02-28T19:29:55.403 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576260 2024-02-28T19:29:55.403 INFO:teuthology.dispatcher.supervisor:Job PID: 3844598 2024-02-28T19:29:55.404 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-28T19:31:55.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:33:55.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:35:55.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:37:55.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:39:55.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:41:55.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:43:55.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:45:55.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:47:56.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:49:56.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:51:56.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:53:56.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:55:56.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:57:56.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:57:56.477 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1