2024-02-20T19:07:04.820 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-20T19:07:04.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:07:04.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa905151f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa9061c5c10>, signals=[15])
2024-02-20T19:07:04.966 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-02-20T19:07:04.966 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T19:07:04.966 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-02-20T19:07:04.981 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-02-20T19:07:04.981 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T19:07:04.981 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-02-20T19:07:05.108 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T19:07:05.112 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10)
2024-02-20T19:07:05.154 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2024-02-20T19:07:05.159 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream
2024-02-20T19:07:05.420 INFO:teuthology.orchestra.console.smithi104:Power off
2024-02-20T19:07:05.421 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T19:07:05.433 INFO:teuthology.orchestra.console.smithi102:Power off
2024-02-20T19:07:05.434 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T19:07:05.443 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-02-20T19:07:05.444 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:05.457 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-02-20T19:07:05.457 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:05.465 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-02-20T19:07:05.479 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-02-20T19:07:09.468 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:09.480 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:09.578 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-02-20T19:07:09.589 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-02-20T19:07:13.583 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:13.590 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:13.693 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-02-20T19:07:13.701 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-02-20T19:07:13.794 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-02-20T19:07:13.895 INFO:teuthology.orchestra.console.smithi104:Power on
2024-02-20T19:07:13.895 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T19:07:13.917 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-02-20T19:07:13.918 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:13.942 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-02-20T19:07:17.706 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:17.815 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-02-20T19:07:17.915 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-02-20T19:07:17.943 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:18.017 INFO:teuthology.orchestra.console.smithi102:Power on
2024-02-20T19:07:18.017 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T19:07:18.038 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-02-20T19:07:18.038 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:18.052 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-02-20T19:07:18.059 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-02-20T19:07:22.057 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:22.065 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T19:07:22.168 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-02-20T19:07:22.176 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-02-20T19:07:22.269 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-02-20T19:07:22.277 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-02-20T19:07:22.370 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-02-20T19:07:22.378 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-02-20T19:09:53.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:09:56.284 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:02.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:05.340 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:08.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:08.592 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-20T19:10:11.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:14.400 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:20.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:23.456 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:29.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:32.508 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:38.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:41.568 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:47.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:10:50.620 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-02-20T19:10:56.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:11:12.594 WARNING:teuthology.provision.fog.smithi102:timed out
2024-02-20T19:11:18.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:11:56.625 WARNING:teuthology.provision.fog.smithi104:timed out
2024-02-20T19:12:02.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:12:02.840 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T19:12:02.841 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T19:12:03.170 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-02-20T19:12:03.171 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-02-20T19:12:03.185 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2024-02-20T19:12:03.186 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2024-02-20T19:12:03.240 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-02-20T19:12:03.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-02-20T19:12:03.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2024-02-20T19:12:03.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-02-20T19:12:03.469 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2024-02-20T19:12:03.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-02-20T19:12:03.604 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T19:12:03.658 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T19:12:03.659 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T19:12:03.660 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-02-20T19:12:03.662 DEBUG:teuthology.parallel:result is None
2024-02-20T19:12:18.598 WARNING:teuthology.provision.fog.smithi102:timed out
2024-02-20T19:12:24.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:12:24.823 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T19:12:24.823 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T19:12:25.204 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-02-20T19:12:25.204 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-02-20T19:12:25.218 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-02-20T19:12:25.218 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-02-20T19:12:25.276 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-02-20T19:12:25.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-02-20T19:12:25.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-02-20T19:12:25.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-02-20T19:12:25.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-02-20T19:12:25.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-02-20T19:12:25.619 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-02-20T19:12:25.677 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-02-20T19:12:25.677 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-02-20T19:12:25.677 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T19:12:25.678 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T19:12:25.679 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-02-20T19:12:25.679 DEBUG:teuthology.parallel:result is None
2024-02-20T19:12:25.872 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-02-20T19:12:25.872 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T19:12:25.895 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-02-20T19:12:25.896 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T19:12:25.913 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-02-20T19:12:25.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-02-20T19:12:25.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:12:25.999 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-02-20T19:12:26.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-02-20T19:12:26.066 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-02-20T19:12:26.123 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-02-20T19:12:26.123 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-02-20T19:12:26.181 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T19:12:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T19:12:26.183 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-02-20T19:12:26.204 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-02-20T19:12:26.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-02-20T19:12:26.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T19:12:26.290 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-02-20T19:12:26.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-02-20T19:12:26.360 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-02-20T19:12:26.416 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-02-20T19:12:26.416 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-20T19:12:26.472 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-20T19:12:26.473 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-20T19:12:26.473 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-02-20T19:12:26.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:12:26.574 INFO:teuthology.dispatcher.supervisor:Running job 7568208
2024-02-20T19:12:26.574 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-02-20_00:28:35-rgw-wip-cbodley-testing-distro-default-smithi/7568208 --name cbodley-2024-02-20_00:28:35-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-02-20_00:28:35-rgw-wip-cbodley-testing-distro-default-smithi/7568208/orig.config.yaml
2024-02-20T19:12:26.577 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-02-20_00:28:35-rgw-wip-cbodley-testing-distro-default-smithi/7568208
2024-02-20T19:12:26.577 INFO:teuthology.dispatcher.supervisor:Job PID: 2025930
2024-02-20T19:12:26.577 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-20T19:14:26.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:16:26.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:18:26.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:20:26.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:22:26.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:24:26.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:26:27.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:28:27.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:30:27.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:32:27.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:34:27.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:36:27.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:38:27.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:40:27.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:42:27.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:44:27.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:46:27.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:48:27.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:50:27.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:52:27.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:54:28.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:56:28.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T19:58:28.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:00:28.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:02:28.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:04:28.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:06:28.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:08:28.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:10:28.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:12:28.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:14:28.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:16:28.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:18:29.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:20:29.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:22:29.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:24:29.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:26:29.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:28:29.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:30:29.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:32:29.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:34:29.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:36:29.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:38:29.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:40:29.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:42:29.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:44:30.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:46:30.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:48:30.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:50:30.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:52:30.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:54:30.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:56:30.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:58:30.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:00:30.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:02:30.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:04:30.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:06:30.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:08:30.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:10:30.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:12:31.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:14:31.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:16:31.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:18:31.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:20:31.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:22:31.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:24:31.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:26:31.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:28:31.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:30:31.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:32:31.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:34:32.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:36:32.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:38:32.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:40:32.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:42:32.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:44:32.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:46:32.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:48:32.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:50:32.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:52:32.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:54:32.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:56:32.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T21:58:32.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:00:33.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:02:33.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:04:33.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:06:33.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:08:33.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:10:33.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T22:10:33.702 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1