2023-12-12T06:54:45.298 INFO:root:teuthology version: 0.0.1.dev221+g82df7da
2023-12-12T06:54:45.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T06:54:45.438 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa728c7dd90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa728980e50>, signals=[15])
2023-12-12T06:54:45.438 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-12-12T06:54:45.439 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T06:54:45.439 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-12T06:54:45.466 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-12-12T06:54:45.466 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T06:54:45.466 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-12T06:54:45.579 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-12T06:54:45.609 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-12T06:54:45.628 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6
2023-12-12T06:54:45.660 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.6
2023-12-12T06:54:45.870 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-12T06:54:45.870 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T06:54:45.884 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-12T06:54:45.884 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T06:54:45.894 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-12T06:54:45.894 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:45.907 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-12T06:54:45.907 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:45.917 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-12T06:54:45.933 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-12T06:54:49.922 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:49.934 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:50.032 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-12T06:54:50.043 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-12T06:54:54.037 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:54.046 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:54.148 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-12T06:54:54.155 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-12T06:54:54.249 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-12T06:54:54.350 INFO:teuthology.orchestra.console.smithi120:Power on
2023-12-12T06:54:54.350 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T06:54:54.373 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2023-12-12T06:54:54.373 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:54.397 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-12T06:54:58.159 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:58.269 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T06:54:58.370 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-12T06:54:58.399 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:58.475 INFO:teuthology.orchestra.console.smithi111:Power on
2023-12-12T06:54:58.476 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T06:54:58.497 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-12-12T06:54:58.497 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:54:58.508 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-12T06:54:58.522 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T06:55:02.512 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:55:02.522 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T06:55:02.622 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-12T06:55:02.631 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-12T06:55:02.723 INFO:teuthology.orchestra.console.smithi120:Power on completed
2023-12-12T06:55:02.733 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-12-12T06:55:02.824 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-12-12T06:55:02.834 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-12-12T06:57:48.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:57:51.942 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:57:57.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:01.026 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:03.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:07.014 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:07.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:10.082 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:13.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:16.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:16.102 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:19.142 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:22.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:25.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:25.190 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:28.230 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:31.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:34.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:34.281 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:37.314 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:40.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:43.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:43.362 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:46.374 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-12T06:58:49.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:52.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:58:52.422 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:58:58.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:59:01.506 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:59:07.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:59:10.562 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-12T06:59:16.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:59:52.416 WARNING:teuthology.provision.fog.smithi120:timed out
2023-12-12T06:59:58.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T06:59:58.748 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T06:59:58.749 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T06:59:59.026 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-12-12T06:59:59.026 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-12-12T06:59:59.043 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120
2023-12-12T06:59:59.044 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120 /etc/hosts
2023-12-12T06:59:59.102 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2023-12-12T06:59:59.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-12T06:59:59.209 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hosts
2023-12-12T06:59:59.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2023-12-12T06:59:59.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hostname
2023-12-12T06:59:59.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-12T06:59:59.439 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-12T06:59:59.495 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux"
2023-12-12T06:59:59.495 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:
2023-12-12T06:59:59.496 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-12T06:59:59.497 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-12T06:59:59.497 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-12T06:59:59.497 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-12T06:59:59.498 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2023-12-12T06:59:59.500 DEBUG:teuthology.parallel:result is None
2023-12-12T07:00:16.582 WARNING:teuthology.provision.fog.smithi111:timed out
2023-12-12T07:00:22.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T07:00:22.827 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T07:00:22.827 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T07:00:23.160 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-12-12T07:00:23.161 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-12-12T07:00:23.180 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-12-12T07:00:23.181 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-12-12T07:00:23.240 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-12-12T07:00:23.241 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-12T07:00:23.369 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-12-12T07:00:23.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-12-12T07:00:23.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-12-12T07:00:23.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-12T07:00:23.608 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-12T07:00:23.665 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-12T07:00:23.665 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-12T07:00:23.666 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-12T07:00:23.666 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-12T07:00:23.666 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-12T07:00:23.667 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-12T07:00:23.667 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-12T07:00:23.667 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-12T07:00:23.667 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-12T07:00:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-12T07:00:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-12T07:00:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T07:00:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-12T07:00:23.669 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-12T07:00:23.669 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-12T07:00:23.669 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-12T07:00:23.669 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-12T07:00:23.670 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-12-12T07:00:23.670 DEBUG:teuthology.parallel:result is None
2023-12-12T07:00:23.835 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-12-12T07:00:23.835 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-12T07:00:23.857 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2023-12-12T07:00:23.857 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-12T07:00:23.875 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-12-12T07:00:23.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-12T07:00:23.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T07:00:23.941 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-12-12T07:00:24.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-12T07:00:24.008 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-12-12T07:00:24.064 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-12-12T07:00:24.065 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-12T07:00:24.121 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-12T07:00:24.122 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T07:00:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-12T07:00:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-12T07:00:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-12T07:00:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-12T07:00:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-12T07:00:24.123 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-12T07:00:24.141 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2023-12-12T07:00:24.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-12T07:00:24.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T07:00:24.208 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-12-12T07:00:24.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-12T07:00:24.345 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2023-12-12T07:00:24.403 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2023-12-12T07:00:24.403 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-12T07:00:24.461 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux"
2023-12-12T07:00:24.462 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)"
2023-12-12T07:00:24.462 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel"
2023-12-12T07:00:24.462 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora"
2023-12-12T07:00:24.462 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6"
2023-12-12T07:00:24.463 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-12-12T07:00:24.463 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-12T07:00:24.463 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-12T07:00:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-12T07:00:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/"
2023-12-12T07:00:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-12T07:00:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-12T07:00:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:
2023-12-12T07:00:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-12T07:00:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-12T07:00:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-12T07:00:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-12T07:00:24.467 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-12T07:00:24.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T07:00:24.577 INFO:teuthology.dispatcher.supervisor:Running job 7488105
2023-12-12T07:00:24.577 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_82df7da8b73a06b3ef6f01839360c5ffc298e158/virtualenv/bin/teuthology -v --owner zmc --archive /home/teuthworker/archive/zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi/7488105 --name zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi --description orch:cephadm:smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi/7488105/orig.config.yaml
2023-12-12T07:00:24.581 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi/7488105
2023-12-12T07:00:24.582 INFO:teuthology.dispatcher.supervisor:Job PID: 1424985
2023-12-12T07:00:24.582 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-12T07:02:24.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T07:04:24.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T07:06:25.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T07:08:25.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T07:08:25.239 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-12T07:08:25.329 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-12T07:08:25.329 INFO:teuthology.nuke:Checking targets against current locks
2023-12-12T07:08:25.372 DEBUG:teuthology.nuke:shortname: smithi111
2023-12-12T07:08:25.372 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T07:08:25.394 DEBUG:teuthology.nuke:shortname: smithi120
2023-12-12T07:08:25.394 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T07:08:25.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi/7488105', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 06:54:44.469768', 'locked_by': 'zmc', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-12T07:08:25.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-12-12_02:28:27-orch:cephadm:smoke-main-distro-default-smithi/7488105', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 06:54:44.467884', 'locked_by': 'zmc', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-12T07:08:25.469 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-12T07:08:25.470 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T07:08:25.482 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-12T07:08:25.482 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T07:08:25.491 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-12T07:08:25.491 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T07:08:25.503 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-12T07:08:25.503 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T07:08:25.512 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-12T07:08:25.526 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-12T07:08:25.612 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-12T07:08:25.627 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-12T07:08:25.763 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2023-12-12T07:08:25.772 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com