2023-12-14T10:38:04.992 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T10:38:04.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:38:05.134 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2a430bd2b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2a44015940>, signals=[15])
2023-12-14T10:38:05.135 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-12-14T10:38:05.135 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T10:38:05.135 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-14T10:38:05.157 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-12-14T10:38:05.157 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T10:38:05.157 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-14T10:38:05.265 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10)
2023-12-14T10:38:05.290 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10)
2023-12-14T10:38:05.307 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream
2023-12-14T10:38:05.329 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream
2023-12-14T10:38:05.581 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-14T10:38:05.582 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T10:38:05.594 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-14T10:38:05.595 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T10:38:05.608 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-14T10:38:05.608 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:05.616 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-14T10:38:05.616 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:05.630 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-14T10:38:05.637 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-14T10:38:09.635 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:09.644 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:09.747 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-14T10:38:09.755 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-14T10:38:13.749 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:13.757 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:13.859 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-14T10:38:13.866 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-14T10:38:13.967 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-14T10:38:14.067 INFO:teuthology.orchestra.console.smithi120:Power on
2023-12-14T10:38:14.068 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T10:38:14.091 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2023-12-14T10:38:14.091 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:14.115 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-14T10:38:17.864 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:17.972 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-14T10:38:18.073 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-14T10:38:18.116 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:18.174 INFO:teuthology.orchestra.console.smithi124:Power on
2023-12-14T10:38:18.174 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T10:38:18.193 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-12-14T10:38:18.194 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:18.214 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-14T10:38:18.224 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-14T10:38:22.217 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:22.224 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T10:38:22.326 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-14T10:38:22.332 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-14T10:38:22.427 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-12-14T10:38:22.433 INFO:teuthology.orchestra.console.smithi120:Power on completed
2023-12-14T10:38:22.528 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-12-14T10:38:22.534 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-12-14T10:41:08.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:08.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:11.828 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:41:11.829 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:41:17.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:17.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:20.914 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:41:20.914 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:41:26.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:26.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:30.001 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:41:30.003 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:41:36.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:36.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:39.090 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:41:39.090 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:41:45.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:48.178 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:41:48.178 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:41:54.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:54.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:41:57.266 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:42:03.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:12.626 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:42:18.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:21.714 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:42:21.841 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:42:27.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:27.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:30.805 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-14T10:42:30.897 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:42:36.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:36.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:37.021 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T10:42:37.022 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T10:42:39.954 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-14T10:42:45.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:42:46.366 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T10:42:46.366 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T10:42:57.358 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-12-14T10:42:57.359 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-12-14T10:42:57.378 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-12-14T10:42:57.378 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-12-14T10:42:57.436 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-12-14T10:42:57.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-14T10:42:57.581 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-12-14T10:42:57.613 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-12-14T10:42:57.682 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-12-14T10:42:57.750 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-14T10:42:57.818 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-14T10:42:57.874 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-12-14T10:42:57.875 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-14T10:42:57.875 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-14T10:42:57.875 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T10:42:57.875 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-14T10:42:57.875 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T10:42:57.875 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-12-14T10:42:57.877 DEBUG:teuthology.parallel:result is None
2023-12-14T10:43:01.681 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-12-14T10:43:01.681 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-12-14T10:43:01.699 INFO:teuthology.orchestra.run.smithi120.stdout:smithi046
2023-12-14T10:43:01.700 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi046 /etc/hosts
2023-12-14T10:43:01.757 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2023-12-14T10:43:01.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-14T10:43:01.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi046/smithi120/g' /etc/hosts
2023-12-14T10:43:01.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.46/172.21.15.120/g' /etc/hosts
2023-12-14T10:43:02.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi046/smithi120/g' /etc/hostname
2023-12-14T10:43:02.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-14T10:43:02.143 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-14T10:43:02.198 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-14T10:43:02.199 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon"
2023-12-14T10:43:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-14T10:43:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-12-14T10:43:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T10:43:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-14T10:43:02.200 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T10:43:02.200 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2023-12-14T10:43:02.201 DEBUG:teuthology.parallel:result is None
2023-12-14T10:43:02.372 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2023-12-14T10:43:02.372 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T10:43:02.400 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-12-14T10:43:02.400 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T10:43:02.426 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2023-12-14T10:43:02.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-14T10:43:02.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:43:02.510 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-12-14T10:43:02.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-14T10:43:02.576 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2023-12-14T10:43:02.632 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2023-12-14T10:43:02.632 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9"
2023-12-14T10:43:02.687 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-14T10:43:02.688 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T10:43:02.689 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-14T10:43:02.708 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-12-14T10:43:02.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-14T10:43:02.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T10:43:02.792 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-12-14T10:43:02.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-14T10:43:02.863 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-12-14T10:43:02.920 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-12-14T10:43:02.921 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-14T10:43:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-14T10:43:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-12-14T10:43:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-14T10:43:02.977 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T10:43:02.978 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-14T10:43:02.979 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T10:43:02.979 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-14T10:43:03.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:43:03.087 INFO:teuthology.dispatcher.supervisor:Running job 7491214
2023-12-14T10:43:03.087 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi/7491214 --name yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi/7491214/orig.config.yaml
2023-12-14T10:43:03.091 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi/7491214
2023-12-14T10:43:03.091 INFO:teuthology.dispatcher.supervisor:Job PID: 3448897
2023-12-14T10:43:03.091 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T10:45:03.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:47:03.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:49:03.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:51:03.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:53:03.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:55:04.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:57:04.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T10:59:04.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:01:04.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:03:04.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:05:04.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:07:04.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:09:05.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:11:05.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:13:05.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:15:05.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:17:05.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:19:05.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:21:06.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:23:06.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:25:06.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:27:06.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:29:06.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:31:07.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:33:07.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:35:07.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:37:07.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:39:07.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:41:07.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:43:08.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:45:08.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:47:08.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:49:08.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:51:08.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:53:08.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:55:08.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:57:09.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T11:59:09.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:01:09.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:03:09.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:05:09.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:07:09.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:09:09.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:11:10.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:13:10.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:15:10.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:17:10.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:19:10.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:21:11.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:23:11.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:25:11.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:27:11.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:29:12.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:31:12.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:33:12.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:35:12.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:37:12.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:39:13.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:41:13.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:43:13.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:45:13.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:47:13.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:49:13.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T12:49:13.870 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T12:49:14.003 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T12:49:14.004 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T12:49:14.047 DEBUG:teuthology.nuke:shortname: smithi120
2023-12-14T12:49:14.047 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T12:49:14.067 DEBUG:teuthology.nuke:shortname: smithi124
2023-12-14T12:49:14.067 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T12:49:14.071 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi/7491214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 10:38:04.206315', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiDTvYD1vK7lsz0YJ59bFHn4CIVfSbT+UeSGePHAJPDW5igFUXMZcfyh5oUednjJgIJJ1TAsgr2sGrWA+EAseI='}
2023-12-14T12:49:14.094 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-12-14_10:36:48-rgw-wip-yuval-test-gsoc-distro-default-smithi/7491214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 10:38:04.207921', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKW0/ezDQPWVcLxsFVM3W+ASlZls54bxwczSlHTab2OronV5G01sbwVQEZx1GT86OcCKa3syuhK5vtRf2vzw7Ys='}
2023-12-14T12:49:14.122 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-14T12:49:14.123 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T12:49:14.151 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-14T12:49:14.151 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T12:49:14.164 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-14T12:49:14.164 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T12:49:14.172 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-14T12:49:14.187 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-14T12:49:14.187 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T12:49:14.206 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-14T12:49:14.273 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-14T12:49:14.308 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-14T12:49:14.442 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2023-12-14T12:49:14.449 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com