2023-12-13T01:58:16.154 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-13T01:58:16.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T01:58:16.287 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6ee7f0d2b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6ee8e65940>, signals=[15])
2023-12-13T01:58:16.287 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging
2023-12-13T01:58:16.288 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T01:58:16.288 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2023-12-13T01:58:16.306 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-12-13T01:58:16.307 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T01:58:16.307 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-13T01:58:16.420 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-13T01:58:16.442 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-13T01:58:16.462 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of rhel 8.6
2023-12-13T01:58:16.505 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.6
2023-12-13T01:58:16.715 INFO:teuthology.orchestra.console.smithi001:Power off
2023-12-13T01:58:16.715 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T01:58:16.738 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2023-12-13T01:58:16.738 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:16.750 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-13T01:58:16.751 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T01:58:16.762 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-12-13T01:58:16.770 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-13T01:58:16.770 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:16.793 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-13T01:58:20.766 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:20.794 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:20.878 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-12-13T01:58:20.904 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-13T01:58:24.882 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:24.905 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:24.993 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-12-13T01:58:25.013 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-13T01:58:28.998 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:29.014 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:29.107 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-12-13T01:58:29.122 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-13T01:58:29.209 INFO:teuthology.orchestra.console.smithi001:Power off completed
2023-12-13T01:58:29.223 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-13T01:58:29.311 INFO:teuthology.orchestra.console.smithi001:Power on
2023-12-13T01:58:29.311 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T01:58:29.324 INFO:teuthology.orchestra.console.smithi120:Power on
2023-12-13T01:58:29.324 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T01:58:29.336 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On
2023-12-13T01:58:29.336 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:29.345 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2023-12-13T01:58:29.345 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:29.358 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-12-13T01:58:29.366 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-13T01:58:33.362 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:33.369 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:33.471 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-12-13T01:58:33.478 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-13T01:58:33.573 INFO:teuthology.orchestra.console.smithi001:Power on completed
2023-12-13T01:58:33.674 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2023-12-13T01:58:37.482 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T01:58:37.636 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-12-13T01:58:37.737 INFO:teuthology.orchestra.console.smithi120:Power on completed
2023-12-13T01:58:37.838 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-12-13T02:01:04.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:07.554 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:13.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:16.610 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:22.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:23.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:25.666 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:26.754 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:01:31.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:32.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:34.722 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:35.810 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:01:40.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:41.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:43.782 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:44.866 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:01:49.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:52.866 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:01:53.922 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:01:58.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:01:59.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:02:01.922 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-12-13T02:02:02.978 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:02:07.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:02:08.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:02:12.034 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-12-13T02:02:18.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:03:07.981 WARNING:teuthology.provision.fog.smithi001:timed out
2023-12-13T02:03:13.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:03:14.323 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T02:03:14.324 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T02:03:14.622 INFO:teuthology.provision.fog.smithi001:Node is ready
2023-12-13T02:03:14.622 DEBUG:teuthology.orchestra.run.smithi001:> hostname
2023-12-13T02:03:14.641 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2023-12-13T02:03:14.641 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts
2023-12-13T02:03:14.703 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2023-12-13T02:03:14.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2023-12-13T02:03:14.839 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts
2023-12-13T02:03:14.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts
2023-12-13T02:03:14.942 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname
2023-12-13T02:03:15.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2023-12-13T02:03:15.079 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)"
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel"
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora"
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6"
2023-12-13T02:03:15.138 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T02:03:15.139 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-13T02:03:15.140 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2023-12-13T02:03:15.141 DEBUG:teuthology.parallel:result is None
2023-12-13T02:03:18.042 WARNING:teuthology.provision.fog.smithi120:timed out
2023-12-13T02:03:24.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:03:24.372 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T02:03:24.372 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T02:03:24.679 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-12-13T02:03:24.679 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-12-13T02:03:24.697 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120
2023-12-13T02:03:24.697 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120 /etc/hosts
2023-12-13T02:03:24.754 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2023-12-13T02:03:24.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-13T02:03:24.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hosts
2023-12-13T02:03:24.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2023-12-13T02:03:24.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hostname
2023-12-13T02:03:25.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-12-13T02:03:25.103 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-13T02:03:25.160 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T02:03:25.160 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)"
2023-12-13T02:03:25.160 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel"
2023-12-13T02:03:25.161 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora"
2023-12-13T02:03:25.161 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6"
2023-12-13T02:03:25.161 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-12-13T02:03:25.161 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-13T02:03:25.162 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-13T02:03:25.162 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-13T02:03:25.162 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T02:03:25.162 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T02:03:25.163 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T02:03:25.163 INFO:teuthology.orchestra.run.smithi120.stdout:
2023-12-13T02:03:25.163 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T02:03:25.163 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-13T02:03:25.164 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T02:03:25.164 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-13T02:03:25.164 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2023-12-13T02:03:25.165 DEBUG:teuthology.parallel:result is None
2023-12-13T02:03:25.425 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2023-12-13T02:03:25.426 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T02:03:25.445 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2023-12-13T02:03:25.446 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T02:03:25.465 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2023-12-13T02:03:25.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2023-12-13T02:03:25.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:03:25.536 DEBUG:teuthology.orchestra.run.smithi001:> true
2023-12-13T02:03:25.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com'
2023-12-13T02:03:25.670 DEBUG:teuthology.orchestra.run.smithi001:> uname -m
2023-12-13T02:03:25.734 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2023-12-13T02:03:25.735 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2023-12-13T02:03:25.795 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T02:03:25.795 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)"
2023-12-13T02:03:25.795 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel"
2023-12-13T02:03:25.796 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora"
2023-12-13T02:03:25.796 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6"
2023-12-13T02:03:25.796 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2023-12-13T02:03:25.796 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-13T02:03:25.797 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2023-12-13T02:03:25.797 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-13T02:03:25.797 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T02:03:25.797 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T02:03:25.798 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T02:03:25.799 INFO:teuthology.orchestra.run.smithi001.stdout:
2023-12-13T02:03:25.799 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T02:03:25.799 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-13T02:03:25.799 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T02:03:25.800 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-13T02:03:25.800 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2023-12-13T02:03:25.821 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2023-12-13T02:03:25.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-13T02:03:25.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T02:03:25.889 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-12-13T02:03:25.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-12-13T02:03:25.958 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2023-12-13T02:03:26.015 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2023-12-13T02:03:26.015 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-12-13T02:03:26.071 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T02:03:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:
2023-12-13T02:03:26.073 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T02:03:26.073 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-13T02:03:26.073 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T02:03:26.073 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-13T02:03:26.073 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-12-13T02:03:26.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T02:03:26.189 INFO:teuthology.dispatcher.supervisor:Running job 7489358
2023-12-13T02:03:26.190 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489358 --name yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489358/orig.config.yaml
2023-12-13T02:03:26.193 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489358
2023-12-13T02:03:26.193 INFO:teuthology.dispatcher.supervisor:Job PID: 1042508
2023-12-13T02:03:26.194 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-13T02:05:26.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T02:07:26.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T02:09:26.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T02:11:26.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T02:11:26.864 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-13T02:11:26.976 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-13T02:11:26.976 INFO:teuthology.nuke:Checking targets against current locks
2023-12-13T02:11:27.025 DEBUG:teuthology.nuke:shortname: smithi001
2023-12-13T02:11:27.026 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T02:11:27.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489358', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:58:15.295908', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-13T02:11:27.053 DEBUG:teuthology.nuke:shortname: smithi120
2023-12-13T02:11:27.053 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T02:11:27.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489358', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:58:15.294488', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-13T02:11:27.105 INFO:teuthology.orchestra.console.smithi001:Power off
2023-12-13T02:11:27.105 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T02:11:27.123 INFO:teuthology.orchestra.console.smithi120:Power off
2023-12-13T02:11:27.123 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T02:11:27.131 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2023-12-13T02:11:27.131 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T02:11:27.145 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-12-13T02:11:27.145 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T02:11:27.154 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-12-13T02:11:27.166 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-12-13T02:11:27.255 INFO:teuthology.orchestra.console.smithi001:Power off completed
2023-12-13T02:11:27.267 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-12-13T02:11:27.403 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com
2023-12-13T02:11:27.413 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com