2024-03-11T15:15:17.812 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T15:15:17.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:15:17.951 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0ebd69c10>, signals=[15]) 2024-03-11T15:15:17.951 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-03-11T15:15:17.952 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T15:15:17.952 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-11T15:15:17.972 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2024-03-11T15:15:17.972 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T15:15:17.973 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-03-11T15:15:18.099 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T15:15:18.109 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T15:15:18.149 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2024-03-11T15:15:18.160 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 9.stream 2024-03-11T15:15:18.372 INFO:teuthology.orchestra.console.smithi157:Power off 2024-03-11T15:15:18.373 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T15:15:18.386 INFO:teuthology.orchestra.console.smithi148:Power off 2024-03-11T15:15:18.386 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T15:15:18.397 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-03-11T15:15:18.398 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:18.408 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-03-11T15:15:18.408 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:18.421 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-11T15:15:18.430 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-11T15:15:22.426 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:22.433 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:22.536 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-11T15:15:22.542 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-11T15:15:26.541 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:26.549 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:26.652 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-03-11T15:15:26.658 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-11T15:15:26.753 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-03-11T15:15:26.759 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-03-11T15:15:26.854 INFO:teuthology.orchestra.console.smithi157:Power on 2024-03-11T15:15:26.854 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T15:15:26.862 INFO:teuthology.orchestra.console.smithi148:Power on 2024-03-11T15:15:26.863 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T15:15:26.878 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2024-03-11T15:15:26.878 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:26.886 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-03-11T15:15:26.886 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:26.899 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-03-11T15:15:26.906 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-11T15:15:30.904 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:30.912 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:31.014 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-03-11T15:15:31.021 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-11T15:15:35.017 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:35.024 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T15:15:35.126 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-11T15:15:35.133 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-11T15:15:35.228 INFO:teuthology.orchestra.console.smithi157:Power on completed 2024-03-11T15:15:35.234 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-03-11T15:15:35.329 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2024-03-11T15:15:35.335 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-03-11T15:18:06.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:18:06.304 ERROR:teuthology.orchestra.connection:Error authenticating with smithi148.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-11T15:18:36.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:18:39.454 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:18:45.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:18:48.514 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:18:54.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:18:57.566 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:03.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:06.622 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:10.307 WARNING:teuthology.provision.fog.smithi148:timed out 2024-03-11T15:19:12.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:15.678 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:16.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:21.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:24.734 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:30.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:33.790 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:42.846 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:48.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:19:51.902 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-11T15:19:57.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:20:16.311 WARNING:teuthology.provision.fog.smithi148:timed out 2024-03-11T15:20:22.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:20:22.584 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T15:20:22.585 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T15:20:22.946 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-03-11T15:20:22.947 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-03-11T15:20:22.962 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-03-11T15:20:22.962 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-03-11T15:20:23.018 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-03-11T15:20:23.018 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-11T15:20:23.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-03-11T15:20:23.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-03-11T15:20:23.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-03-11T15:20:23.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-11T15:20:23.371 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-03-11T15:20:23.426 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T15:20:23.427 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T15:20:23.428 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-03-11T15:20:23.429 DEBUG:teuthology.parallel:result is None 2024-03-11T15:20:57.907 WARNING:teuthology.provision.fog.smithi157:timed out 2024-03-11T15:21:03.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:21:04.357 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T15:21:04.357 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T15:21:04.691 INFO:teuthology.provision.fog.smithi157:Node is ready 2024-03-11T15:21:04.691 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2024-03-11T15:21:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2024-03-11T15:21:04.706 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2024-03-11T15:21:04.762 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2024-03-11T15:21:04.762 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-03-11T15:21:04.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2024-03-11T15:21:04.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2024-03-11T15:21:04.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2024-03-11T15:21:05.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-03-11T15:21:05.098 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-03-11T15:21:05.152 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T15:21:05.153 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T15:21:05.153 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T15:21:05.153 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2024-03-11T15:21:05.153 DEBUG:teuthology.parallel:result is None 2024-03-11T15:21:05.320 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-03-11T15:21:05.320 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T15:21:05.344 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2024-03-11T15:21:05.344 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T15:21:05.361 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-03-11T15:21:05.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-11T15:21:05.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:21:05.450 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-03-11T15:21:05.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-03-11T15:21:05.617 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-03-11T15:21:05.671 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-03-11T15:21:05.672 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T15:21:05.726 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-03-11T15:21:05.727 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T15:21:05.727 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T15:21:05.727 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T15:21:05.727 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-11T15:21:05.752 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2024-03-11T15:21:05.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-11T15:21:05.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T15:21:05.841 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-03-11T15:21:05.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-11T15:21:05.908 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-03-11T15:21:05.963 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-03-11T15:21:05.963 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-03-11T15:21:06.017 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-03-11T15:21:06.018 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T15:21:06.019 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T15:21:06.019 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T15:21:06.019 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-03-11T15:21:06.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:21:06.139 INFO:teuthology.dispatcher.supervisor:Running job 7591443 2024-03-11T15:21:06.139 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-03-11_15:10:19-rgw-wip-rgw-account-v3-distro-default-smithi/7591443 --name cbodley-2024-03-11_15:10:19-rgw-wip-rgw-account-v3-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-03-11_15:10:19-rgw-wip-rgw-account-v3-distro-default-smithi/7591443/orig.config.yaml 2024-03-11T15:21:06.142 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-03-11_15:10:19-rgw-wip-rgw-account-v3-distro-default-smithi/7591443 2024-03-11T15:21:06.143 INFO:teuthology.dispatcher.supervisor:Job PID: 1993005 2024-03-11T15:21:06.143 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T15:23:06.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:25:06.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:27:06.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:29:06.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:31:06.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:33:06.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:35:06.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:37:06.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:39:06.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:41:06.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:43:06.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:45:06.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:47:07.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:49:07.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:51:07.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:53:07.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:55:07.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:57:07.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T15:59:07.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:01:07.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:03:07.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:05:07.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:07:07.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:09:07.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:11:07.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:13:08.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:15:08.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:17:08.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:19:08.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:21:08.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:23:08.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:25:08.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:27:08.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:29:08.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:31:08.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:33:08.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:35:08.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:37:09.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:39:09.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:41:09.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:43:09.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:45:09.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:47:09.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:49:09.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:51:09.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:53:09.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:55:09.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:57:09.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T16:59:09.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:01:09.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:03:10.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:05:10.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:07:10.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:09:10.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:11:10.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:13:10.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:15:10.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:17:10.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:19:10.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:21:10.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:23:10.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:25:10.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:27:10.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:29:11.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:31:11.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:33:11.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:35:11.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:37:11.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:39:11.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:41:11.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:43:11.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:45:11.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:47:11.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:49:11.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:51:11.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:53:11.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:55:12.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:57:12.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T17:59:12.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:01:12.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:03:12.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:05:12.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:07:12.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:09:12.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:11:12.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:13:12.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:15:12.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:17:12.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:19:12.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:21:12.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:23:13.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:25:13.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T18:25:13.189 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1