2024-01-24T03:10:52.675 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T03:10:52.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:10:52.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4d6fdd1f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4d70d75c10>, signals=[15])
2024-01-24T03:10:52.817 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-01-24T03:10:52.817 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T03:10:52.817 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-01-24T03:10:52.836 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2024-01-24T03:10:52.837 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T03:10:52.837 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-24T03:10:52.969 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10)
2024-01-24T03:10:52.973 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10)
2024-01-24T03:10:53.019 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream
2024-01-24T03:10:53.022 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream
2024-01-24T03:10:53.273 INFO:teuthology.orchestra.console.smithi032:Power off
2024-01-24T03:10:53.274 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T03:10:53.289 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-24T03:10:53.290 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T03:10:53.299 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-01-24T03:10:53.299 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:10:53.312 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-24T03:10:53.312 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:10:53.321 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-24T03:10:53.336 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-24T03:10:57.324 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:10:57.337 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:10:57.433 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-24T03:10:57.445 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-24T03:11:01.436 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:01.445 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:01.545 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-24T03:11:01.554 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-24T03:11:01.646 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-01-24T03:11:01.747 INFO:teuthology.orchestra.console.smithi032:Power on
2024-01-24T03:11:01.747 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T03:11:01.768 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-01-24T03:11:01.769 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:01.790 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-24T03:11:05.556 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:05.665 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T03:11:05.766 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-24T03:11:05.791 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:05.867 INFO:teuthology.orchestra.console.smithi194:Power on
2024-01-24T03:11:05.868 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T03:11:05.892 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2024-01-24T03:11:05.893 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:05.901 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-24T03:11:05.913 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T03:11:09.904 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:09.914 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T03:11:10.023 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-24T03:11:10.107 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-24T03:11:10.124 INFO:teuthology.orchestra.console.smithi194:Power on completed
2024-01-24T03:11:10.208 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-01-24T03:11:10.225 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2024-01-24T03:11:10.309 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-01-24T03:13:41.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:13:44.252 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-24T03:13:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:13:53.308 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-24T03:13:56.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:13:59.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:13:59.328 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:02.364 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-24T03:14:05.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:08.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:08.412 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:11.420 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-24T03:14:14.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:17.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:17.472 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:23.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:26.556 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:32.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:35.612 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:41.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:14:44.668 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T03:14:50.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:15:17.444 WARNING:teuthology.provision.fog.smithi032:timed out
2024-01-24T03:15:23.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:15:23.726 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T03:15:23.727 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T03:15:24.047 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-01-24T03:15:24.047 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-01-24T03:15:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-01-24T03:15:24.063 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-01-24T03:15:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-01-24T03:15:24.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-01-24T03:15:24.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-01-24T03:15:24.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-01-24T03:15:24.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-01-24T03:15:24.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-01-24T03:15:24.478 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-01-24T03:15:24.532 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-01-24T03:15:24.532 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-01-24T03:15:24.532 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-01-24T03:15:24.533 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-01-24T03:15:24.535 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T03:15:24.535 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-01-24T03:15:24.535 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T03:15:24.535 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T03:15:24.535 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T03:15:24.536 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-01-24T03:15:24.537 DEBUG:teuthology.parallel:result is None
2024-01-24T03:15:50.700 WARNING:teuthology.provision.fog.smithi194:timed out
2024-01-24T03:15:56.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:15:57.083 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T03:15:57.083 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T03:15:57.399 INFO:teuthology.provision.fog.smithi194:Node is ready
2024-01-24T03:15:57.400 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2024-01-24T03:15:57.415 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com
2024-01-24T03:15:57.415 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts
2024-01-24T03:15:57.471 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2024-01-24T03:15:57.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-24T03:15:57.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts
2024-01-24T03:15:57.598 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2024-01-24T03:15:57.666 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname
2024-01-24T03:15:57.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-24T03:15:57.799 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-24T03:15:57.853 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T03:15:57.854 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T03:15:57.855 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T03:15:57.855 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2024-01-24T03:15:57.855 DEBUG:teuthology.parallel:result is None
2024-01-24T03:15:58.028 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-01-24T03:15:58.029 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T03:15:58.054 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2024-01-24T03:15:58.054 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T03:15:58.071 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-01-24T03:15:58.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-01-24T03:15:58.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:15:58.174 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-01-24T03:15:58.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-01-24T03:15:58.354 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-01-24T03:15:58.409 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-01-24T03:15:58.409 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-01-24T03:15:58.466 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-01-24T03:15:58.466 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-01-24T03:15:58.466 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-01-24T03:15:58.466 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-01-24T03:15:58.466 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T03:15:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-01-24T03:15:58.468 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T03:15:58.468 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T03:15:58.468 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T03:15:58.469 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-01-24T03:15:58.504 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2024-01-24T03:15:58.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-24T03:15:58.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T03:15:58.596 DEBUG:teuthology.orchestra.run.smithi194:> true
2024-01-24T03:15:58.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-24T03:15:58.662 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2024-01-24T03:15:58.716 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2024-01-24T03:15:58.717 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-24T03:15:58.770 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-01-24T03:15:58.770 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-01-24T03:15:58.770 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-01-24T03:15:58.770 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-24T03:15:58.771 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-24T03:15:58.772 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-24T03:15:58.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:15:58.883 INFO:teuthology.dispatcher.supervisor:Running job 7530020
2024-01-24T03:15:58.883 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530020 --name yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} -- /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530020/orig.config.yaml
2024-01-24T03:15:58.885 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530020
2024-01-24T03:15:58.886 INFO:teuthology.dispatcher.supervisor:Job PID: 3966219
2024-01-24T03:15:58.886 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T03:17:58.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:19:59.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:21:59.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:23:59.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:25:59.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:27:59.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:29:59.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:32:00.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:34:00.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:36:00.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:38:00.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:40:00.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:42:00.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:44:01.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:46:01.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:48:01.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:50:01.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:52:01.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:54:01.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:56:02.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T03:58:02.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:00:02.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T04:00:02.509 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T04:00:02.613 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T04:00:02.613 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T04:00:02.662 DEBUG:teuthology.nuke:shortname: smithi032
2024-01-24T04:00:02.662 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T04:00:02.688 DEBUG:teuthology.nuke:shortname: smithi194
2024-01-24T04:00:02.688 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T04:00:02.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 03:10:51.602182', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKK7iEZ3sSW3pPbeLN0b9Q1lt7I2LLAGqlj21XQicFoyXj6ITtMj3EdqxvAd7tnDA5St4QjSWkc5vOVYKPAE/bY='}
2024-01-24T04:00:02.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-23_23:02:31-rados-wip-yuri5-testing-2024-01-23-0805-distro-default-smithi/7530020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 03:10:51.603663', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBYn4YGWLdBjjxtkjUa13/ZVlEfYTzT/5+yC3LJQKCMQxsIQRaAhYjjq1RSEC1tdmP4guTUsnVG/elYbPpElHI='}
2024-01-24T04:00:02.740 INFO:teuthology.orchestra.console.smithi032:Power off
2024-01-24T04:00:02.743 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T04:00:02.768 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-01-24T04:00:02.768 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T04:00:02.784 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-24T04:00:02.785 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T04:00:02.794 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-24T04:00:02.807 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-24T04:00:02.807 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T04:00:02.829 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T04:00:02.895 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-01-24T04:00:02.930 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-24T04:00:03.049 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2024-01-24T04:00:03.075 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com