2023-11-21T13:28:24.207 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-21T13:28:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:28:24.341 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f15a77669a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f15a7464ca0>, signals=[15])
2023-11-21T13:28:24.341 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2023-11-21T13:28:24.342 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2023-11-21T13:28:24.342 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-11-21T13:28:24.366 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2023-11-21T13:28:24.367 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2023-11-21T13:28:24.367 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-11-21T13:28:24.478 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10)
2023-11-21T13:28:24.496 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10)
2023-11-21T13:28:24.528 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream
2023-11-21T13:28:24.539 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream
2023-11-21T13:28:24.784 INFO:teuthology.orchestra.console.smithi052:Power off
2023-11-21T13:28:24.785 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-21T13:28:24.802 INFO:teuthology.orchestra.console.smithi045:Power off
2023-11-21T13:28:24.802 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-21T13:28:24.892 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off
2023-11-21T13:28:24.892 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:24.900 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-11-21T13:28:24.900 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:24.923 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on
2023-11-21T13:28:24.929 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-11-21T13:28:28.926 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:28.934 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:29.038 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on
2023-11-21T13:28:29.042 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-11-21T13:28:33.042 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:33.050 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:33.152 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-11-21T13:28:33.158 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-11-21T13:28:33.254 INFO:teuthology.orchestra.console.smithi045:Power off completed
2023-11-21T13:28:33.259 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-11-21T13:28:33.355 INFO:teuthology.orchestra.console.smithi045:Power on
2023-11-21T13:28:33.355 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-21T13:28:33.363 INFO:teuthology.orchestra.console.smithi052:Power on
2023-11-21T13:28:33.363 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-21T13:28:33.379 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On
2023-11-21T13:28:33.379 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:33.388 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2023-11-21T13:28:33.389 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:33.402 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-11-21T13:28:33.412 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-11-21T13:28:37.406 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:37.413 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:37.515 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-11-21T13:28:37.521 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-11-21T13:28:41.518 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:41.524 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:28:41.626 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on
2023-11-21T13:28:41.633 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-11-21T13:28:41.728 INFO:teuthology.orchestra.console.smithi045:Power on completed
2023-11-21T13:28:41.734 INFO:teuthology.orchestra.console.smithi052:Power on completed
2023-11-21T13:28:41.829 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2023-11-21T13:28:41.835 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2023-11-21T13:31:12.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:12.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:31.042 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-11-21T13:31:31.043 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-11-21T13:31:37.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:37.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:40.098 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-11-21T13:31:40.098 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-11-21T13:31:46.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:46.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:49.157 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-11-21T13:31:49.157 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-11-21T13:31:55.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:55.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:31:58.246 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-11-21T13:32:04.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:32:55.214 WARNING:teuthology.provision.fog.smithi045:timed out
2023-11-21T13:33:01.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:33:01.478 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-21T13:33:01.478 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-21T13:33:01.824 INFO:teuthology.provision.fog.smithi045:Node is ready
2023-11-21T13:33:01.824 DEBUG:teuthology.orchestra.run.smithi045:> hostname
2023-11-21T13:33:01.839 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2023-11-21T13:33:01.839 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts
2023-11-21T13:33:01.894 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2023-11-21T13:33:01.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-11-21T13:33:02.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts
2023-11-21T13:33:02.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts
2023-11-21T13:33:02.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname
2023-11-21T13:33:02.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-11-21T13:33:02.249 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-11-21T13:33:02.304 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-21T13:33:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-21T13:33:02.306 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2023-11-21T13:33:02.307 DEBUG:teuthology.parallel:result is None
2023-11-21T13:33:04.254 WARNING:teuthology.provision.fog.smithi052:timed out
2023-11-21T13:33:10.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:33:10.493 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-21T13:33:10.493 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-21T13:33:10.833 INFO:teuthology.provision.fog.smithi052:Node is ready
2023-11-21T13:33:10.833 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2023-11-21T13:33:10.848 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2023-11-21T13:33:10.848 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2023-11-21T13:33:10.903 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2023-11-21T13:33:10.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-11-21T13:33:11.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2023-11-21T13:33:11.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2023-11-21T13:33:11.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2023-11-21T13:33:11.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-11-21T13:33:11.258 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2023-11-21T13:33:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-21T13:33:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-21T13:33:11.314 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2023-11-21T13:33:11.315 DEBUG:teuthology.parallel:result is None
2023-11-21T13:33:11.488 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2023-11-21T13:33:11.489 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-21T13:33:11.512 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2023-11-21T13:33:11.512 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-21T13:33:11.530 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2023-11-21T13:33:11.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-11-21T13:33:11.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:33:11.630 DEBUG:teuthology.orchestra.run.smithi045:> true
2023-11-21T13:33:11.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-11-21T13:33:11.699 DEBUG:teuthology.orchestra.run.smithi045:> uname -m
2023-11-21T13:33:11.757 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2023-11-21T13:33:11.757 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-11-21T13:33:11.814 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream"
2023-11-21T13:33:11.814 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-21T13:33:11.815 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-21T13:33:11.816 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-11-21T13:33:11.838 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2023-11-21T13:33:11.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-11-21T13:33:11.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-21T13:33:11.931 DEBUG:teuthology.orchestra.run.smithi052:> true
2023-11-21T13:33:11.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-11-21T13:33:11.997 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2023-11-21T13:33:12.052 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2023-11-21T13:33:12.052 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-11-21T13:33:12.107 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2023-11-21T13:33:12.107 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2023-11-21T13:33:12.107 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2023-11-21T13:33:12.107 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2023-11-21T13:33:12.108 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2023-11-21T13:33:12.108 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2023-11-21T13:33:12.108 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-21T13:33:12.108 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-11-21T13:33:12.109 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2023-11-21T13:33:12.109 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-21T13:33:12.109 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2023-11-21T13:33:12.109 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-21T13:33:12.109 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-21T13:33:12.110 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-21T13:33:12.110 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-11-21T13:33:12.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:33:12.216 INFO:teuthology.dispatcher.supervisor:Running job 7463850
2023-11-21T13:33:12.216 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_mbenjamin@teuthology --archive /home/teuthworker/archive/mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi/7463850 --name mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi/7463850/orig.config.yaml
2023-11-21T13:33:12.219 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi/7463850
2023-11-21T13:33:12.219 INFO:teuthology.dispatcher.supervisor:Job PID: 4093721
2023-11-21T13:33:12.220 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-21T13:35:12.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:37:12.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:39:12.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:41:12.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:43:12.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:45:13.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:47:13.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:49:13.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-21T13:49:13.534 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-21T13:49:13.636 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-21T13:49:13.636 INFO:teuthology.nuke:Checking targets against current locks
2023-11-21T13:49:13.682 DEBUG:teuthology.nuke:shortname: smithi045
2023-11-21T13:49:13.683 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-21T13:49:13.702 DEBUG:teuthology.nuke:shortname: smithi052
2023-11-21T13:49:13.702 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-21T13:49:13.704 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi/7463850', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-21 13:28:23.428302', 'locked_by': 'scheduled_mbenjamin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0UVEor2nSfazyKSHd85TNXURSO+J1RcIlUidnhfjE9A3lfOcljMb4pSfyuzjLEwtmV4xKp+7avV5AV+X3lqcg='}
2023-11-21T13:49:13.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mbenjamin-2023-11-21_13:22:02-rgw-fix-lambda-capture-by-ref-distro-default-smithi/7463850', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-21 13:28:23.430333', 'locked_by': 'scheduled_mbenjamin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWoCRJB6ibUZhbUdUujVtvbMCoKhEH7rLCwjwp5aVPSyPqugxr3Z8PwKdSkUCyMSR8GoECNNlOC8ryMNqQ1JtQ='}
2023-11-21T13:49:13.749 INFO:teuthology.orchestra.console.smithi045:Power off
2023-11-21T13:49:13.749 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-21T13:49:13.770 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off
2023-11-21T13:49:13.771 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:49:13.784 INFO:teuthology.orchestra.console.smithi052:Power off
2023-11-21T13:49:13.784 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-21T13:49:13.790 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2023-11-21T13:49:13.804 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-11-21T13:49:13.804 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-21T13:49:13.823 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-11-21T13:49:13.892 INFO:teuthology.orchestra.console.smithi045:Power off completed
2023-11-21T13:49:13.925 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-11-21T13:49:14.043 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2023-11-21T13:49:14.066 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com