2024-02-28T19:06:37.911 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T19:06:37.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:06:38.063 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f282ba09c10>, signals=[15]) 2024-02-28T19:06:38.064 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2024-02-28T19:06:38.064 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T19:06:38.064 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-28T19:06:38.093 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2024-02-28T19:06:38.093 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T19:06:38.094 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-02-28T19:06:38.211 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2024-02-28T19:06:38.235 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_8.stream (ID 3) 2024-02-28T19:06:38.252 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2024-02-28T19:06:38.281 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream 2024-02-28T19:06:38.484 INFO:teuthology.orchestra.console.smithi023:Power off 2024-02-28T19:06:38.485 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T19:06:38.504 INFO:teuthology.orchestra.console.smithi204:Power off 2024-02-28T19:06:38.505 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T19:06:38.513 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-02-28T19:06:38.514 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:38.527 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-02-28T19:06:38.528 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:38.546 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T19:06:38.549 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-28T19:06:42.548 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:42.555 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:42.658 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T19:06:42.664 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-28T19:06:46.660 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:46.667 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:46.769 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T19:06:46.777 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-28T19:06:50.772 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:50.780 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:50.882 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-28T19:06:50.888 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-28T19:06:50.983 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-02-28T19:06:50.989 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-02-28T19:06:51.084 INFO:teuthology.orchestra.console.smithi023:Power on 2024-02-28T19:06:51.085 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T19:06:51.091 INFO:teuthology.orchestra.console.smithi204:Power on 2024-02-28T19:06:51.092 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T19:06:51.106 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2024-02-28T19:06:51.106 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:51.114 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2024-02-28T19:06:51.115 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:51.129 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-02-28T19:06:51.137 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-28T19:06:55.132 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:55.140 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T19:06:55.242 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-02-28T19:06:55.248 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-28T19:06:55.343 INFO:teuthology.orchestra.console.smithi023:Power on completed 2024-02-28T19:06:55.348 INFO:teuthology.orchestra.console.smithi204:Power on completed 2024-02-28T19:06:55.444 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2024-02-28T19:06:55.449 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2024-02-28T19:09:56.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:09:59.676 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:05.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:08.736 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:11.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:11.805 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-28T19:10:14.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:17.788 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:23.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:26.844 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:32.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:35.900 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:41.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:44.956 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:10:50.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:10:54.012 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-28T19:11:00.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:11:15.809 WARNING:teuthology.provision.fog.smithi023:timed out 2024-02-28T19:11:21.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:11:24.892 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T19:11:30.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:11:33.948 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T19:11:39.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:11:43.004 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-02-28T19:11:49.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:12:00.016 WARNING:teuthology.provision.fog.smithi204:timed out 2024-02-28T19:12:06.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:12:06.234 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T19:12:06.234 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T19:12:06.477 INFO:teuthology.provision.fog.smithi204:Node is ready 2024-02-28T19:12:06.477 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2024-02-28T19:12:06.496 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2024-02-28T19:12:06.497 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2024-02-28T19:12:06.557 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2024-02-28T19:12:06.557 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-02-28T19:12:06.682 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2024-02-28T19:12:06.714 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2024-02-28T19:12:06.783 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2024-02-28T19:12:06.852 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-02-28T19:12:06.920 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-02-28T19:12:06.978 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:12:06.979 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:12:06.980 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:12:06.980 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2024-02-28T19:12:06.982 DEBUG:teuthology.parallel:result is None 2024-02-28T19:12:49.008 WARNING:teuthology.provision.fog.smithi023:timed out 2024-02-28T19:12:55.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:12:55.266 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T19:12:55.267 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T19:12:55.545 INFO:teuthology.provision.fog.smithi023:Node is ready 2024-02-28T19:12:55.545 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2024-02-28T19:12:55.565 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2024-02-28T19:12:55.565 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2024-02-28T19:12:55.626 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2024-02-28T19:12:55.626 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-28T19:12:55.731 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2024-02-28T19:12:55.761 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2024-02-28T19:12:55.832 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2024-02-28T19:12:55.900 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2024-02-28T19:12:55.968 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:12:56.027 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-28T19:12:56.028 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:12:56.028 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:12:56.028 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:12:56.028 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:12:56.028 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:12:56.028 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2024-02-28T19:12:56.029 DEBUG:teuthology.parallel:result is None 2024-02-28T19:12:56.194 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2024-02-28T19:12:56.194 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T19:12:56.219 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2024-02-28T19:12:56.219 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T19:12:56.254 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2024-02-28T19:12:56.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T19:12:56.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:12:56.332 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-02-28T19:12:56.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-02-28T19:12:56.398 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-02-28T19:12:56.457 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-02-28T19:12:56.457 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:12:56.515 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:12:56.516 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-02-28T19:12:56.544 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2024-02-28T19:12:56.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-28T19:12:56.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T19:12:56.619 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-02-28T19:12:56.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-28T19:12:56.759 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-02-28T19:12:56.818 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-02-28T19:12:56.818 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-02-28T19:12:56.876 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-28T19:12:56.877 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T19:12:56.878 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-02-28T19:12:56.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:12:57.008 INFO:teuthology.dispatcher.supervisor:Running job 7576235 2024-02-28T19:12:57.008 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576235 --name pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576235/orig.config.yaml 2024-02-28T19:12:57.013 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-28_18:57:10-fs:upgrade:mds_upgrade_sequence-reef-distro-default-smithi/7576235 2024-02-28T19:12:57.013 INFO:teuthology.dispatcher.supervisor:Job PID: 3749647 2024-02-28T19:12:57.013 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-28T19:14:57.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:16:57.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:18:57.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:20:57.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:22:57.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:24:57.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:26:57.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:28:57.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:30:57.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:32:57.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:34:58.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:36:58.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:38:58.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:40:58.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:42:58.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:44:58.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T19:44:58.503 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1