2023-11-23T02:26:17.481 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T02:26:17.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:26:17.602 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb65d3508b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb65d04ef70>, signals=[15])
2023-11-23T02:26:17.603 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-11-23T02:26:17.603 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:26:17.603 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-11-23T02:26:17.625 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2023-11-23T02:26:17.625 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:26:17.625 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-11-23T02:26:17.736 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:26:17.749 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:26:17.778 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-11-23T02:26:17.796 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream
2023-11-23T02:26:18.213 INFO:teuthology.orchestra.console.smithi098:Power off
2023-11-23T02:26:18.213 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:26:18.225 INFO:teuthology.orchestra.console.smithi173:Power off
2023-11-23T02:26:18.225 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:26:18.233 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-11-23T02:26:18.233 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:18.245 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2023-11-23T02:26:18.245 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:18.252 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-11-23T02:26:18.265 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-23T02:26:18.353 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-11-23T02:26:18.366 INFO:teuthology.orchestra.console.smithi173:Power off completed
2023-11-23T02:26:18.454 INFO:teuthology.orchestra.console.smithi098:Power on
2023-11-23T02:26:18.455 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:26:18.467 INFO:teuthology.orchestra.console.smithi173:Power on
2023-11-23T02:26:18.467 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:26:18.474 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2023-11-23T02:26:18.474 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:18.485 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On
2023-11-23T02:26:18.486 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:18.494 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-11-23T02:26:18.504 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-23T02:26:22.498 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:22.505 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:26:22.606 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-11-23T02:26:22.613 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2023-11-23T02:26:22.708 INFO:teuthology.orchestra.console.smithi098:Power on completed
2023-11-23T02:26:22.714 INFO:teuthology.orchestra.console.smithi173:Power on completed
2023-11-23T02:26:22.808 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-11-23T02:26:22.815 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2023-11-23T02:29:26.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:29:26.923 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-23T02:30:30.926 WARNING:teuthology.provision.fog.smithi098:timed out
2023-11-23T02:30:36.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:30:55.330 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-11-23T02:31:01.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:31:04.386 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-11-23T02:31:10.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:31:10.660 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:31:10.660 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:31:30.902 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-11-23T02:31:30.903 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-11-23T02:31:30.926 INFO:teuthology.orchestra.run.smithi098.stdout:smithi193
2023-11-23T02:31:30.927 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi193 /etc/hosts
2023-11-23T02:31:30.987 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-11-23T02:31:30.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-11-23T02:31:31.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi193/smithi098/g' /etc/hosts
2023-11-23T02:31:31.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.193/172.21.15.98/g' /etc/hosts
2023-11-23T02:31:31.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi193/smithi098/g' /etc/hostname
2023-11-23T02:31:31.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-11-23T02:31:31.389 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-11-23T02:31:31.448 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-11-23T02:31:31.448 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-11-23T02:31:31.448 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-11-23T02:31:31.448 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:31:31.449 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:31:31.450 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-11-23T02:31:31.451 DEBUG:teuthology.parallel:result is None
2023-11-23T02:33:41.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:33:44.930 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:33:50.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:33:53.990 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:33:59.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:03.046 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:34:09.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:12.102 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:34:18.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:21.154 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:34:27.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:30.214 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:34:36.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:34:54.690 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:35:00.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:03.746 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-11-23T02:35:09.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:11.594 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:35:11.594 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:35:36.432 INFO:teuthology.provision.fog.smithi173:Node is ready
2023-11-23T02:35:36.433 DEBUG:teuthology.orchestra.run.smithi173:> hostname
2023-11-23T02:35:36.457 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2023-11-23T02:35:36.457 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts
2023-11-23T02:35:36.517 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2023-11-23T02:35:36.517 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2023-11-23T02:35:36.629 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts
2023-11-23T02:35:36.660 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts
2023-11-23T02:35:36.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname
2023-11-23T02:35:36.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2023-11-23T02:35:36.865 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2023-11-23T02:35:36.923 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:35:36.924 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:35:36.925 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2023-11-23T02:35:36.925 DEBUG:teuthology.parallel:result is None
2023-11-23T02:35:37.105 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-11-23T02:35:37.105 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:35:37.126 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2023-11-23T02:35:37.127 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:35:37.152 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:35:37.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-11-23T02:35:37.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:37.224 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-11-23T02:35:37.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-11-23T02:35:37.357 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-11-23T02:35:37.415 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-11-23T02:35:37.415 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-11-23T02:35:37.473 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:35:37.474 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:35:37.475 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:35:37.475 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-11-23T02:35:37.493 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:35:37.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-11-23T02:35:37.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:35:37.558 DEBUG:teuthology.orchestra.run.smithi173:> true
2023-11-23T02:35:37.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com'
2023-11-23T02:35:37.625 DEBUG:teuthology.orchestra.run.smithi173:> uname -m
2023-11-23T02:35:37.683 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2023-11-23T02:35:37.683 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2023-11-23T02:35:37.740 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:35:37.741 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:35:37.742 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-11-23T02:35:37.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:35:37.886 INFO:teuthology.dispatcher.supervisor:Running job 7464509
2023-11-23T02:35:37.886 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464509 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464509/orig.config.yaml
2023-11-23T02:35:37.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464509
2023-11-23T02:35:37.890 INFO:teuthology.dispatcher.supervisor:Job PID: 230349
2023-11-23T02:35:37.890 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T02:37:37.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:39:37.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:41:38.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:43:38.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:45:38.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:47:38.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:49:38.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:51:38.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:53:38.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:55:38.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:57:38.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:59:38.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:01:38.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:03:38.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:05:39.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:07:39.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:09:39.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:11:39.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:13:39.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:15:39.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:17:39.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:19:39.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:21:39.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:23:39.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:25:39.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:27:39.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:29:39.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:31:39.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:33:40.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:35:40.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:37:40.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:39:40.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:41:40.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:43:40.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:45:40.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:47:40.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:49:40.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:51:40.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:53:40.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:53:40.766 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T03:53:40.888 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T03:53:40.888 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T03:53:40.934 DEBUG:teuthology.nuke:shortname: smithi098
2023-11-23T03:53:40.935 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:53:40.958 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:26:16.721545', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd1ji5HYmmgXC3OLq0boNmI4YjCchVBG4nv+VWC3dhWDV16QIl9CnvFzv/Vxc4LYwfyjLyp3PwG+QfVl24rjkM='}
2023-11-23T03:53:40.961 DEBUG:teuthology.nuke:shortname: smithi173
2023-11-23T03:53:40.961 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:53:40.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:26:16.719733', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETVWPGIgCaT5g59Ry3l2AVK1LfCZc0V0YB+sm/HAPoBUCWh1G9GVPfN/6uHzghqlN3/T2sYmU9C11RdyUWYGcQ='}
2023-11-23T03:53:41.011 INFO:teuthology.orchestra.console.smithi098:Power off
2023-11-23T03:53:41.011 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:53:41.026 INFO:teuthology.orchestra.console.smithi173:Power off
2023-11-23T03:53:41.026 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:53:41.034 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-11-23T03:53:41.035 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:53:41.049 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2023-11-23T03:53:41.049 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:53:41.057 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-11-23T03:53:41.069 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2023-11-23T03:53:41.158 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-11-23T03:53:41.170 INFO:teuthology.orchestra.console.smithi173:Power off completed
2023-11-23T03:53:41.308 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-11-23T03:53:41.317 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com