2023-11-23T19:54:02.006 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T19:54:02.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T19:54:02.144 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb8d72ff8b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb8d6ffec10>, signals=[15])
2023-11-23T19:54:02.144 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-11-23T19:54:02.144 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T19:54:02.145 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-23T19:54:02.161 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-11-23T19:54:02.161 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T19:54:02.162 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-11-23T19:54:02.286 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10)
2023-11-23T19:54:02.292 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10)
2023-11-23T19:54:02.345 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream
2023-11-23T19:54:02.348 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream
2023-11-23T19:54:02.589 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-23T19:54:02.589 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T19:54:02.600 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-23T19:54:02.601 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T19:54:02.610 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-11-23T19:54:02.611 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:02.622 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-23T19:54:02.623 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:02.631 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-23T19:54:02.643 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-23T19:54:02.733 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-11-23T19:54:02.833 INFO:teuthology.orchestra.console.smithi114:Power on
2023-11-23T19:54:02.833 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T19:54:02.853 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2023-11-23T19:54:02.854 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:02.873 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-23T19:54:06.646 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:06.754 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-23T19:54:06.875 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:06.983 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-23T19:54:10.758 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:10.867 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-23T19:54:10.985 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:11.093 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-11-23T19:54:11.194 INFO:teuthology.orchestra.console.smithi114:Power on completed
2023-11-23T19:54:11.294 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2023-11-23T19:54:14.870 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:14.978 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-23T19:54:15.078 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-23T19:54:15.179 INFO:teuthology.orchestra.console.smithi081:Power on
2023-11-23T19:54:15.179 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T19:54:15.200 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-11-23T19:54:15.200 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:15.222 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-23T19:54:19.226 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T19:54:19.335 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-23T19:54:19.435 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-11-23T19:54:19.536 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-11-23T19:56:44.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:57:02.950 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-23T19:57:08.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:57:12.002 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-23T19:57:18.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:57:21.090 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-23T19:57:27.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:57:30.146 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-23T19:57:36.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:58:36.162 WARNING:teuthology.provision.fog.smithi114:timed out
2023-11-23T19:58:42.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T19:58:42.406 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T19:58:42.406 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T19:58:42.721 INFO:teuthology.provision.fog.smithi114:Node is ready
2023-11-23T19:58:42.721 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2023-11-23T19:58:42.735 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2023-11-23T19:58:42.736 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts
2023-11-23T19:58:42.791 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2023-11-23T19:58:42.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-11-23T19:58:42.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts
2023-11-23T19:58:42.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2023-11-23T19:58:42.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname
2023-11-23T19:58:43.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-11-23T19:58:43.122 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-11-23T19:58:43.178 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2023-11-23T19:58:43.179 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-23T19:58:43.179 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-11-23T19:58:43.179 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T19:58:43.179 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-23T19:58:43.179 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T19:58:43.179 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2023-11-23T19:58:43.181 DEBUG:teuthology.parallel:result is None
2023-11-23T20:00:59.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:02.214 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:08.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:11.298 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:17.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:20.354 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:26.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:29.442 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:35.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:38.530 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:44.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:47.586 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:01:53.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:01:56.674 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-23T20:02:02.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:03:02.740 WARNING:teuthology.provision.fog.smithi081:timed out
2023-11-23T20:03:08.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:03:09.119 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T20:03:09.120 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T20:03:09.430 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-11-23T20:03:09.430 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-11-23T20:03:09.445 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2023-11-23T20:03:09.445 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2023-11-23T20:03:09.500 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-11-23T20:03:09.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-23T20:03:09.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2023-11-23T20:03:09.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-11-23T20:03:09.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2023-11-23T20:03:09.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-23T20:03:09.849 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-23T20:03:09.906 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2023-11-23T20:03:09.906 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2023-11-23T20:03:09.906 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-23T20:03:09.907 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2023-11-23T20:03:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-23T20:03:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2023-11-23T20:03:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T20:03:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-23T20:03:09.908 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T20:03:09.908 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-11-23T20:03:09.909 DEBUG:teuthology.parallel:result is None
2023-11-23T20:03:10.070 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-11-23T20:03:10.070 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T20:03:10.090 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2023-11-23T20:03:10.090 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T20:03:10.107 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-11-23T20:03:10.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-23T20:03:10.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:03:10.188 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-11-23T20:03:10.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-23T20:03:10.256 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-11-23T20:03:10.310 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-11-23T20:03:10.311 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-23T20:03:10.364 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2023-11-23T20:03:10.364 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2023-11-23T20:03:10.364 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2023-11-23T20:03:10.364 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2023-11-23T20:03:10.364 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-23T20:03:10.365 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T20:03:10.366 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-23T20:03:10.390 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2023-11-23T20:03:10.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-11-23T20:03:10.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T20:03:10.472 DEBUG:teuthology.orchestra.run.smithi114:> true
2023-11-23T20:03:10.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-11-23T20:03:10.597 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2023-11-23T20:03:10.651 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2023-11-23T20:03:10.652 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-11-23T20:03:10.706 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-23T20:03:10.707 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T20:03:10.708 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-11-23T20:03:10.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:03:10.818 INFO:teuthology.dispatcher.supervisor:Running job 7465212
2023-11-23T20:03:10.818 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi/7465212 --name cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi/7465212/orig.config.yaml
2023-11-23T20:03:10.821 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi/7465212
2023-11-23T20:03:10.821 INFO:teuthology.dispatcher.supervisor:Job PID: 2544959
2023-11-23T20:03:10.821 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T20:05:10.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:07:11.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:09:11.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:11:11.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:13:11.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:15:11.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:17:11.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:19:12.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:21:12.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:23:12.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:25:12.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:27:12.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:29:12.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:31:13.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:33:13.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:35:13.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:37:13.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:39:13.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:41:13.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:43:14.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:45:14.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:47:14.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:49:14.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:51:14.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:53:14.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:55:15.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:57:15.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T20:59:15.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:01:15.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:03:15.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:05:15.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:07:16.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:09:16.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:11:16.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:13:16.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:15:16.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:17:16.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:19:16.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:21:17.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:23:17.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:25:17.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:27:17.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:29:17.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:31:17.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:33:17.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:35:17.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:37:18.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:39:18.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:41:18.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:43:18.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:45:18.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:47:18.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:49:19.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:51:19.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:53:19.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:55:19.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:57:19.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T21:59:19.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:01:19.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:03:20.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:05:20.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:07:20.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:09:20.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:11:20.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:13:20.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:15:21.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:17:21.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:19:21.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:21:21.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:23:21.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:25:21.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:27:21.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:29:22.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:31:22.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:33:22.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:35:22.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:37:22.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:39:22.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:41:23.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:43:23.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:45:23.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:47:23.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:49:23.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:51:23.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:53:23.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:55:23.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:57:24.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T22:59:24.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:01:24.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:03:24.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:05:24.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:07:24.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:09:24.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T23:09:24.986 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T23:09:25.167 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T23:09:25.168 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T23:09:25.210 DEBUG:teuthology.nuke:shortname: smithi081
2023-11-23T23:09:25.210 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T23:09:25.231 DEBUG:teuthology.nuke:shortname: smithi114
2023-11-23T23:09:25.231 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T23:09:25.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi/7465212', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 19:54:01.258093', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjcEIEmdaOLcY8mceeROr8VMzg1JwWV/Ztlmj2nAo+xEenF5ktWtSwchanZeCqe/Y5XAAtO9+ft2LCg+Wt5pSk='}
2023-11-23T23:09:25.257 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-23_19:53:09-rgw-wip-cbodley-testing-distro-default-smithi/7465212', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 19:54:01.259223', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXSpZW60vVUxcfGt97QbnQqnG6I9HUbYeo6qB7u824QFM+lwW+6jiuKLhFM05rIv0xHwIuFN3qK+gGSsjWAVCA='}
2023-11-23T23:09:25.286 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-23T23:09:25.286 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T23:09:25.301 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-23T23:09:25.301 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T23:09:25.308 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-23T23:09:25.308 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T23:09:25.320 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-11-23T23:09:25.321 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T23:09:25.329 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-23T23:09:25.342 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-23T23:09:25.431 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-23T23:09:25.443 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-11-23T23:09:25.578 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-11-23T23:09:25.587 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com