2023-12-08T03:50:24.252 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-08T03:50:24.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T03:50:24.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f41baaf6430>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f41ba62dca0>, signals=[15])
2023-12-08T03:50:24.384 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2023-12-08T03:50:24.385 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2023-12-08T03:50:24.385 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2023-12-08T03:50:24.405 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-12-08T03:50:24.406 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-12-08T03:50:24.406 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-12-08T03:50:24.516 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10)
2023-12-08T03:50:24.538 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_9.stream (ID 10)
2023-12-08T03:50:24.559 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream
2023-12-08T03:50:24.581 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 9.stream
2023-12-08T03:50:24.788 INFO:teuthology.orchestra.console.smithi053:Power off
2023-12-08T03:50:24.788 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T03:50:24.810 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2023-12-08T03:50:24.810 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:24.823 INFO:teuthology.orchestra.console.smithi062:Power off
2023-12-08T03:50:24.823 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T03:50:24.832 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-12-08T03:50:24.844 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-12-08T03:50:24.845 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:24.866 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-12-08T03:50:28.835 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:28.868 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:28.944 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-12-08T03:50:28.978 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-12-08T03:50:32.949 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:32.980 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:33.060 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-12-08T03:50:33.089 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-12-08T03:50:33.161 INFO:teuthology.orchestra.console.smithi053:Power off completed
2023-12-08T03:50:33.262 INFO:teuthology.orchestra.console.smithi053:Power on
2023-12-08T03:50:33.262 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-08T03:50:33.286 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On
2023-12-08T03:50:33.287 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:33.309 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-12-08T03:50:37.091 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:37.200 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-12-08T03:50:37.301 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-12-08T03:50:37.311 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:37.402 INFO:teuthology.orchestra.console.smithi062:Power on
2023-12-08T03:50:37.402 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-08T03:50:37.419 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-12-08T03:50:37.424 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2023-12-08T03:50:37.424 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:37.446 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-12-08T03:50:41.422 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:41.447 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T03:50:41.531 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2023-12-08T03:50:41.556 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-12-08T03:50:41.633 INFO:teuthology.orchestra.console.smithi053:Power on completed
2023-12-08T03:50:41.657 INFO:teuthology.orchestra.console.smithi062:Power on completed
2023-12-08T03:50:41.734 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2023-12-08T03:50:41.758 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-12-08T03:52:57.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:00.550 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-12-08T03:53:06.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:09.634 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-12-08T03:53:15.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:18.690 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-12-08T03:53:24.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:27.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:27.778 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-12-08T03:53:30.662 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:53:33.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:36.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:36.834 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2023-12-08T03:53:39.750 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:53:42.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:45.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:48.834 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:53:54.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:53:57.922 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:54:03.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:54:06.982 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:54:12.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:54:16.070 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-12-08T03:54:22.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:54:42.850 WARNING:teuthology.provision.fog.smithi053:timed out
2023-12-08T03:54:48.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:54:49.099 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-08T03:54:49.099 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-08T03:54:49.438 INFO:teuthology.provision.fog.smithi053:Node is ready
2023-12-08T03:54:49.438 DEBUG:teuthology.orchestra.run.smithi053:> hostname
2023-12-08T03:54:49.453 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2023-12-08T03:54:49.454 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts
2023-12-08T03:54:49.510 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2023-12-08T03:54:49.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2023-12-08T03:54:49.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts
2023-12-08T03:54:49.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts
2023-12-08T03:54:49.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname
2023-12-08T03:54:49.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2023-12-08T03:54:49.884 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2023-12-08T03:54:49.940 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon"
2023-12-08T03:54:49.941 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-08T03:54:49.941 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2023-12-08T03:54:49.941 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T03:54:49.941 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-08T03:54:49.941 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T03:54:49.942 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2023-12-08T03:54:49.943 DEBUG:teuthology.parallel:result is None
2023-12-08T03:55:22.111 WARNING:teuthology.provision.fog.smithi062:timed out
2023-12-08T03:55:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:55:28.392 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-08T03:55:28.393 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-08T03:55:28.719 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-12-08T03:55:28.719 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-12-08T03:55:28.734 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-12-08T03:55:28.738 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-12-08T03:55:28.791 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-12-08T03:55:28.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-12-08T03:55:28.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-12-08T03:55:28.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-12-08T03:55:29.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-12-08T03:55:29.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-12-08T03:55:29.149 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-12-08T03:55:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-12-08T03:55:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9"
2023-12-08T03:55:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-12-08T03:55:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-12-08T03:55:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-08T03:55:29.204 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T03:55:29.204 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-12-08T03:55:29.205 DEBUG:teuthology.parallel:result is None
2023-12-08T03:55:29.406 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2023-12-08T03:55:29.406 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-08T03:55:29.426 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-12-08T03:55:29.426 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-08T03:55:29.444 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2023-12-08T03:55:29.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2023-12-08T03:55:29.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:55:29.542 DEBUG:teuthology.orchestra.run.smithi053:> true
2023-12-08T03:55:29.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com'
2023-12-08T03:55:29.725 DEBUG:teuthology.orchestra.run.smithi053:> uname -m
2023-12-08T03:55:29.781 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2023-12-08T03:55:29.781 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2023-12-08T03:55:29.836 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream"
2023-12-08T03:55:29.836 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-08T03:55:29.837 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T03:55:29.838 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2023-12-08T03:55:29.867 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-12-08T03:55:29.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-12-08T03:55:29.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T03:55:29.963 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-12-08T03:55:30.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-12-08T03:55:30.034 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-12-08T03:55:30.088 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-12-08T03:55:30.088 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9"
2023-12-08T03:55:30.141 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-08T03:55:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T03:55:30.142 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-12-08T03:55:30.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T03:55:30.257 INFO:teuthology.dispatcher.supervisor:Running job 7482995
2023-12-08T03:55:30.257 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi/7482995 --name kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi/7482995/orig.config.yaml
2023-12-08T03:55:30.262 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi/7482995
2023-12-08T03:55:30.263 INFO:teuthology.dispatcher.supervisor:Job PID: 4117538
2023-12-08T03:55:30.263 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-08T03:57:30.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T03:59:30.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:01:30.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:03:30.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:05:30.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:07:31.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:09:31.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:11:31.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:13:31.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:15:31.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:17:31.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:19:32.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:21:32.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:23:32.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:25:32.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:27:32.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T04:27:32.880 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-08T04:27:32.970 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-08T04:27:32.971 INFO:teuthology.nuke:Checking targets against current locks
2023-12-08T04:27:33.031 DEBUG:teuthology.nuke:shortname: smithi053
2023-12-08T04:27:33.032 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-08T04:27:33.035 DEBUG:teuthology.nuke:shortname: smithi062
2023-12-08T04:27:33.035 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-08T04:27:33.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi/7482995', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 03:50:23.425160', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHsLfRsk12ZmZ2lSPtW3vL/cCGIKetEL0uEwc4B8/byP/vMN+MxBd3iUcK229zVmh6Y5LEXtSr4aGAWdARAOCuU='}
2023-12-08T04:27:33.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-12-08_03:13:00-rgw-wip-kkeithley-zipper-ayn-distro-default-smithi/7482995', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 03:50:23.422877', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhUlXiUMusR4bWaLyBsqnn6vT9uyHL39qXnvNzZrBOKWoTXDCGHO8MOw7o+JR9Mzg2tTX7hd7mJqhAsmLFc0jk='}
2023-12-08T04:27:33.117 INFO:teuthology.orchestra.console.smithi053:Power off
2023-12-08T04:27:33.118 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T04:27:33.130 INFO:teuthology.orchestra.console.smithi062:Power off
2023-12-08T04:27:33.131 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T04:27:33.141 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2023-12-08T04:27:33.141 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T04:27:33.152 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-12-08T04:27:33.153 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T04:27:33.162 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2023-12-08T04:27:33.175 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-12-08T04:27:33.263 INFO:teuthology.orchestra.console.smithi053:Power off completed
2023-12-08T04:27:33.276 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-12-08T04:27:33.412 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com
2023-12-08T04:27:33.420 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com