2024-03-16T22:18:21.174 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-16T22:18:21.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:18:21.319 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0d44ddef40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0d45e3fc10>, signals=[15])
2024-03-16T22:18:21.320 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2024-03-16T22:18:21.320 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2024-03-16T22:18:21.320 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2024-03-16T22:18:21.340 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2024-03-16T22:18:21.340 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2024-03-16T22:18:21.340 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-16T22:18:21.459 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10)
2024-03-16T22:18:21.473 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10)
2024-03-16T22:18:21.506 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream
2024-03-16T22:18:21.515 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream
2024-03-16T22:18:21.744 INFO:teuthology.orchestra.console.smithi090:Power off
2024-03-16T22:18:21.745 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-16T22:18:21.757 INFO:teuthology.orchestra.console.smithi086:Power off
2024-03-16T22:18:21.757 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-16T22:18:21.767 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off
2024-03-16T22:18:21.767 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:21.779 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2024-03-16T22:18:21.779 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:21.788 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-16T22:18:21.800 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-03-16T22:18:25.790 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:25.801 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:25.899 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-16T22:18:25.910 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-03-16T22:18:29.900 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:29.911 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:30.010 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-16T22:18:30.019 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-03-16T22:18:30.120 INFO:teuthology.orchestra.console.smithi086:Power off completed
2024-03-16T22:18:30.220 INFO:teuthology.orchestra.console.smithi086:Power on
2024-03-16T22:18:30.220 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-16T22:18:30.241 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On
2024-03-16T22:18:30.242 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:30.263 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-03-16T22:18:34.012 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:34.121 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-16T22:18:34.222 INFO:teuthology.orchestra.console.smithi090:Power off completed
2024-03-16T22:18:34.264 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:34.323 INFO:teuthology.orchestra.console.smithi090:Power on
2024-03-16T22:18:34.323 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-16T22:18:34.346 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On
2024-03-16T22:18:34.347 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:34.371 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-16T22:18:34.373 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2024-03-16T22:18:38.375 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:38.383 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-16T22:18:38.485 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-16T22:18:38.491 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2024-03-16T22:18:38.587 INFO:teuthology.orchestra.console.smithi090:Power on completed
2024-03-16T22:18:38.592 INFO:teuthology.orchestra.console.smithi086:Power on completed
2024-03-16T22:18:38.688 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2024-03-16T22:18:38.693 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2024-03-16T22:21:09.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:21:27.966 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-03-16T22:21:33.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:21:37.022 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-03-16T22:21:43.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:21:46.078 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-03-16T22:21:52.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:21:54.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:21:55.138 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-03-16T22:22:01.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:04.222 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2024-03-16T22:22:10.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:13.022 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:22:19.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:22.082 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:22:28.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:31.166 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:22:37.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:40.222 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:22:46.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:49.278 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:22:55.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:22:58.334 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-16T22:23:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:23:10.235 WARNING:teuthology.provision.fog.smithi086:timed out
2024-03-16T22:23:16.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:23:16.520 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-16T22:23:16.521 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-16T22:23:16.847 INFO:teuthology.provision.fog.smithi086:Node is ready
2024-03-16T22:23:16.847 DEBUG:teuthology.orchestra.run.smithi086:> hostname
2024-03-16T22:23:16.862 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com
2024-03-16T22:23:16.862 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts
2024-03-16T22:23:16.918 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086
2024-03-16T22:23:16.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2024-03-16T22:23:17.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts
2024-03-16T22:23:17.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts
2024-03-16T22:23:17.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname
2024-03-16T22:23:17.182 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2024-03-16T22:23:17.248 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9"
2024-03-16T22:23:17.302 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-16T22:23:17.303 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-16T22:23:17.304 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2024-03-16T22:23:17.305 DEBUG:teuthology.parallel:result is None
2024-03-16T22:24:04.386 WARNING:teuthology.provision.fog.smithi090:timed out
2024-03-16T22:24:10.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:24:10.674 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-16T22:24:10.674 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-16T22:24:11.019 INFO:teuthology.provision.fog.smithi090:Node is ready
2024-03-16T22:24:11.019 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2024-03-16T22:24:11.033 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2024-03-16T22:24:11.033 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2024-03-16T22:24:11.088 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2024-03-16T22:24:11.088 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-16T22:24:11.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2024-03-16T22:24:11.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2024-03-16T22:24:11.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2024-03-16T22:24:11.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-16T22:24:11.430 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-16T22:24:11.484 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-16T22:24:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-16T22:24:11.486 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2024-03-16T22:24:11.486 DEBUG:teuthology.parallel:result is None
2024-03-16T22:24:11.647 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2024-03-16T22:24:11.648 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-16T22:24:11.670 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2024-03-16T22:24:11.670 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-16T22:24:11.688 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2024-03-16T22:24:11.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2024-03-16T22:24:11.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:24:11.778 DEBUG:teuthology.orchestra.run.smithi086:> true
2024-03-16T22:24:11.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com'
2024-03-16T22:24:11.944 DEBUG:teuthology.orchestra.run.smithi086:> uname -m
2024-03-16T22:24:11.998 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2024-03-16T22:24:11.998 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9"
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9"
2024-03-16T22:24:12.052 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-16T22:24:12.053 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-16T22:24:12.053 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2024-03-16T22:24:12.078 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2024-03-16T22:24:12.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-16T22:24:12.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-16T22:24:12.169 DEBUG:teuthology.orchestra.run.smithi090:> true
2024-03-16T22:24:12.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-16T22:24:12.236 DEBUG:teuthology.orchestra.run.smithi090:> uname -m
2024-03-16T22:24:12.290 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2024-03-16T22:24:12.290 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-16T22:24:12.344 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-16T22:24:12.345 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-16T22:24:12.346 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-16T22:24:12.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:24:12.490 INFO:teuthology.dispatcher.supervisor:Running job 7604023
2024-03-16T22:24:12.491 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-03-15_20:08:03-rgw-wip-cbodley2-testing-distro-default-smithi/7604023 --name cbodley-2024-03-15_20:08:03-rgw-wip-cbodley2-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-03-15_20:08:03-rgw-wip-cbodley2-testing-distro-default-smithi/7604023/orig.config.yaml
2024-03-16T22:24:12.494 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-03-15_20:08:03-rgw-wip-cbodley2-testing-distro-default-smithi/7604023
2024-03-16T22:24:12.494 INFO:teuthology.dispatcher.supervisor:Job PID: 73506
2024-03-16T22:24:12.494 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-16T22:26:12.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:28:12.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:30:12.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:32:13.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:34:13.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:36:13.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:38:13.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:40:13.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:42:13.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:44:14.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:46:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:48:14.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:50:14.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:52:14.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:54:14.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:56:15.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T22:58:15.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:00:15.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:02:15.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:04:15.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:06:15.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:08:16.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:10:16.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:12:16.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:14:16.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:16:16.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:18:16.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:20:17.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:22:17.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:24:17.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:26:17.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:28:17.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:30:17.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:32:18.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:34:18.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:36:18.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:38:18.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:40:18.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:42:18.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:44:19.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:46:19.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:48:19.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:50:19.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:52:19.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:54:19.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:56:19.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-16T23:58:20.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:00:20.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:02:20.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:04:20.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:06:20.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:08:21.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:10:21.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:12:21.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:14:21.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:16:21.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:18:21.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:20:22.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:22:22.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:24:22.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:26:22.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:28:22.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:30:22.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:32:23.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:34:23.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:36:23.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:38:23.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:40:23.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:42:23.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:44:24.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:46:24.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:48:24.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:50:24.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:52:24.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:54:24.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:56:25.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T00:58:25.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:00:25.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:02:25.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:04:25.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:06:26.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:08:26.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:10:26.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:12:26.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:14:26.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:16:27.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:18:27.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:20:27.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:22:27.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:24:27.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:26:27.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:28:28.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:30:28.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:32:28.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:34:28.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T01:34:28.645 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1