2024-03-13T18:09:27.021 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T18:09:27.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:09:27.208 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd6a5216c10>, signals=[15]) 2024-03-13T18:09:27.208 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2024-03-13T18:09:27.208 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:09:27.209 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-03-13T18:09:27.227 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-03-13T18:09:27.227 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:09:27.227 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-13T18:09:27.252 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2024-03-13T18:09:27.252 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:09:27.252 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-13T18:09:27.345 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:09:27.395 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:09:27.398 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:09:27.414 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.stream 2024-03-13T18:09:27.446 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 8.stream 2024-03-13T18:09:27.449 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2024-03-13T18:09:27.889 INFO:teuthology.orchestra.console.smithi077:Power off 2024-03-13T18:09:27.890 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:09:27.903 INFO:teuthology.orchestra.console.smithi119:Power off 2024-03-13T18:09:27.903 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:09:27.913 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-13T18:09:27.913 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:09:27.920 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-03-13T18:09:27.921 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:27.928 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-03-13T18:09:27.928 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:27.936 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-13T18:09:27.936 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:27.943 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-03-13T18:09:27.951 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-13T18:09:27.956 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-13T18:09:31.946 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:31.953 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:31.960 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:32.056 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-03-13T18:09:32.062 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-13T18:09:32.069 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-13T18:09:36.061 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:36.071 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:36.077 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:36.173 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-03-13T18:09:36.178 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-13T18:09:36.185 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-13T18:09:36.274 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-03-13T18:09:36.375 INFO:teuthology.orchestra.console.smithi077:Power on 2024-03-13T18:09:36.375 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:09:36.397 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2024-03-13T18:09:36.397 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:36.416 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-03-13T18:09:40.182 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:40.190 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:40.292 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-13T18:09:40.298 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-13T18:09:40.394 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-03-13T18:09:40.399 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-13T18:09:40.418 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:40.495 INFO:teuthology.orchestra.console.smithi119:Power on 2024-03-13T18:09:40.495 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:09:40.502 INFO:teuthology.orchestra.console.smithi149:Power on 2024-03-13T18:09:40.503 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:09:40.516 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-03-13T18:09:40.516 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:40.525 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2024-03-13T18:09:40.525 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:40.533 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-03-13T18:09:40.538 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-13T18:09:40.546 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-13T18:09:44.536 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:44.543 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:44.550 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:09:44.645 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-03-13T18:09:44.651 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-13T18:09:44.658 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-13T18:09:44.746 INFO:teuthology.orchestra.console.smithi077:Power on completed 2024-03-13T18:09:44.752 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-03-13T18:09:44.758 INFO:teuthology.orchestra.console.smithi149:Power on completed 2024-03-13T18:09:44.848 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2024-03-13T18:09:44.852 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-03-13T18:09:44.859 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2024-03-13T18:12:16.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:31.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:31.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:34.462 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-03-13T18:12:40.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:43.518 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-03-13T18:12:49.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:49.566 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-13T18:12:49.566 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-13T18:12:52.574 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-03-13T18:12:55.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:55.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:58.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:12:58.626 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-13T18:12:58.627 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-13T18:13:01.630 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-03-13T18:13:04.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:04.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:07.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:07.710 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-13T18:13:07.710 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-13T18:13:10.686 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-03-13T18:13:13.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:13.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:16.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:13:16.766 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-13T18:13:22.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:13.770 WARNING:teuthology.provision.fog.smithi119:timed out 2024-03-13T18:14:16.694 WARNING:teuthology.provision.fog.smithi077:timed out 2024-03-13T18:14:19.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:20.005 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:14:20.005 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:14:20.244 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-03-13T18:14:20.244 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-03-13T18:14:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-03-13T18:14:20.263 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-03-13T18:14:20.322 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-03-13T18:14:20.323 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-13T18:14:20.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-03-13T18:14:20.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-03-13T18:14:20.522 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-03-13T18:14:20.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-03-13T18:14:20.657 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2024-03-13T18:14:20.715 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:20.716 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:20.717 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-03-13T18:14:20.718 DEBUG:teuthology.parallel:result is None 2024-03-13T18:14:22.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:22.784 WARNING:teuthology.provision.fog.smithi149:timed out 2024-03-13T18:14:22.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:14:22.956 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:14:23.233 INFO:teuthology.provision.fog.smithi077:Node is ready 2024-03-13T18:14:23.233 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2024-03-13T18:14:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2024-03-13T18:14:23.253 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2024-03-13T18:14:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2024-03-13T18:14:23.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-03-13T18:14:23.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2024-03-13T18:14:23.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2024-03-13T18:14:23.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2024-03-13T18:14:23.574 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-03-13T18:14:23.642 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:23.701 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2024-03-13T18:14:23.702 DEBUG:teuthology.parallel:result is None 2024-03-13T18:14:28.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:29.039 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:14:29.040 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:14:29.313 INFO:teuthology.provision.fog.smithi149:Node is ready 2024-03-13T18:14:29.313 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2024-03-13T18:14:29.332 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149 2024-03-13T18:14:29.332 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149 /etc/hosts 2024-03-13T18:14:29.391 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2024-03-13T18:14:29.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-13T18:14:29.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149/smithi149/g' /etc/hosts 2024-03-13T18:14:29.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2024-03-13T18:14:29.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149/smithi149/g' /etc/hostname 2024-03-13T18:14:29.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-13T18:14:29.755 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-13T18:14:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-13T18:14:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2024-03-13T18:14:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-13T18:14:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:29.814 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2024-03-13T18:14:29.815 DEBUG:teuthology.parallel:result is None 2024-03-13T18:14:30.036 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2024-03-13T18:14:30.036 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:14:30.069 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-03-13T18:14:30.069 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:14:30.085 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2024-03-13T18:14:30.085 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:14:30.103 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:14:30.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-03-13T18:14:30.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:30.180 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-03-13T18:14:30.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-03-13T18:14:30.210 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-03-13T18:14:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-03-13T18:14:30.271 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8" 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8" 2024-03-13T18:14:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:30.332 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-03-13T18:14:30.352 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:14:30.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-13T18:14:30.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:30.426 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-03-13T18:14:30.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-13T18:14:30.456 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-03-13T18:14:30.516 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-03-13T18:14:30.517 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-13T18:14:30.575 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:30.576 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:30.577 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-13T18:14:30.602 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:14:30.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-13T18:14:30.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:14:30.674 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-13T18:14:30.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-13T18:14:30.741 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-13T18:14:30.798 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-13T18:14:30.798 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-13T18:14:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-13T18:14:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2024-03-13T18:14:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-13T18:14:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:14:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:14:30.857 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:14:30.857 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-13T18:14:30.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:14:30.973 INFO:teuthology.dispatcher.supervisor:Running job 7596906 2024-03-13T18:14:30.973 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596906 --name yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596906/orig.config.yaml 2024-03-13T18:14:30.976 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596906 2024-03-13T18:14:30.977 INFO:teuthology.dispatcher.supervisor:Job PID: 3172072 2024-03-13T18:14:30.977 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-13T18:16:31.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:18:31.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:20:31.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:22:31.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:24:31.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:26:31.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:28:32.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:30:32.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:30:32.319 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1