2023-12-20T03:59:44.432 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-20T03:59:44.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T03:59:44.592 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1184d2a2e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1185c84940>, signals=[15])
2023-12-20T03:59:44.592 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2023-12-20T03:59:44.593 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T03:59:44.593 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-12-20T03:59:44.611 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-12-20T03:59:44.611 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T03:59:44.611 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-20T03:59:44.723 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T03:59:44.739 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T03:59:44.769 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6
2023-12-20T03:59:44.783 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.6
2023-12-20T03:59:45.216 INFO:teuthology.orchestra.console.smithi194:Power off
2023-12-20T03:59:45.216 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T03:59:45.230 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-20T03:59:45.231 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T03:59:45.240 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-12-20T03:59:45.240 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:45.251 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-20T03:59:45.251 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:45.259 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2023-12-20T03:59:45.271 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-20T03:59:49.261 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:49.272 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:49.371 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2023-12-20T03:59:49.380 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-20T03:59:53.373 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:53.381 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:53.483 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-12-20T03:59:53.489 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-20T03:59:53.584 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-12-20T03:59:53.685 INFO:teuthology.orchestra.console.smithi194:Power on
2023-12-20T03:59:53.685 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T03:59:53.705 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2023-12-20T03:59:53.705 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:53.727 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-12-20T03:59:57.493 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:57.602 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-20T03:59:57.703 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-20T03:59:57.728 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:57.804 INFO:teuthology.orchestra.console.smithi196:Power on
2023-12-20T03:59:57.804 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T03:59:57.824 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-12-20T03:59:57.824 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:57.836 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-12-20T03:59:57.843 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-20T04:00:01.841 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:00:01.847 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:00:01.949 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2023-12-20T04:00:01.955 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-20T04:00:02.051 INFO:teuthology.orchestra.console.smithi194:Power on completed
2023-12-20T04:00:02.056 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-12-20T04:00:02.151 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2023-12-20T04:00:02.157 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-12-20T04:03:17.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:17.695 ERROR:teuthology.orchestra.connection:Error authenticating with smithi194.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T04:04:21.697 WARNING:teuthology.provision.fog.smithi194:timed out
2023-12-20T04:04:27.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:32.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:35.989 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:04:41.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:45.041 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:04:46.225 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-12-20T04:04:51.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:52.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:54.097 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:04:55.281 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2023-12-20T04:05:00.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:01.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:01.509 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:05:01.509 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:05:03.153 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:05:09.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:12.209 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:05:18.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:21.265 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:05:21.770 INFO:teuthology.provision.fog.smithi194:Node is ready
2023-12-20T04:05:21.770 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2023-12-20T04:05:21.792 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com
2023-12-20T04:05:21.792 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts
2023-12-20T04:05:21.851 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2023-12-20T04:05:21.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-12-20T04:05:21.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts
2023-12-20T04:05:21.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2023-12-20T04:05:22.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname
2023-12-20T04:05:22.134 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-12-20T04:05:22.201 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:05:22.258 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:05:22.259 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:05:22.260 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2023-12-20T04:05:22.261 DEBUG:teuthology.parallel:result is None
2023-12-20T04:05:27.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:30.322 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-20T04:05:36.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:36.327 WARNING:teuthology.provision.fog.smithi196:timed out
2023-12-20T04:06:42.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:42.593 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:06:42.594 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:06:42.875 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-12-20T04:06:42.875 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-12-20T04:06:42.892 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196
2023-12-20T04:06:42.892 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196 /etc/hosts
2023-12-20T04:06:42.953 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-12-20T04:06:42.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-20T04:06:43.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hosts
2023-12-20T04:06:43.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-12-20T04:06:43.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hostname
2023-12-20T04:06:43.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-20T04:06:43.307 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-20T04:06:43.367 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:06:43.367 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:06:43.367 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-20T04:06:43.367 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:06:43.368 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:06:43.369 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-12-20T04:06:43.369 DEBUG:teuthology.parallel:result is None
2023-12-20T04:06:43.513 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2023-12-20T04:06:43.513 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:06:43.538 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-12-20T04:06:43.538 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:06:43.556 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:06:43.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-12-20T04:06:43.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:43.623 DEBUG:teuthology.orchestra.run.smithi194:> true
2023-12-20T04:06:43.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-12-20T04:06:43.763 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2023-12-20T04:06:43.821 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2023-12-20T04:06:43.821 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2023-12-20T04:06:43.878 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:06:43.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:06:43.880 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-12-20T04:06:43.906 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:06:43.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-20T04:06:43.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:43.979 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-12-20T04:06:44.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-20T04:06:44.047 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-12-20T04:06:44.108 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-12-20T04:06:44.108 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-20T04:06:44.168 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:06:44.168 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:06:44.168 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-20T04:06:44.168 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:06:44.169 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:06:44.170 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:06:44.170 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-20T04:06:44.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:06:44.271 INFO:teuthology.dispatcher.supervisor:Running job 7497394
2023-12-20T04:06:44.271 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497394 --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497394/orig.config.yaml
2023-12-20T04:06:44.274 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497394
2023-12-20T04:06:44.274 INFO:teuthology.dispatcher.supervisor:Job PID: 3408669
2023-12-20T04:06:44.274 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-20T04:08:44.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:10:44.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:12:44.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:14:44.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:14:44.606 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-20T04:14:44.794 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-20T04:14:44.794 INFO:teuthology.nuke:Checking targets against current locks
2023-12-20T04:14:44.844 DEBUG:teuthology.nuke:shortname: smithi194
2023-12-20T04:14:44.844 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:14:44.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:43.565083', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIInnm0OE+7s+7x1RYXgv03D+MeqVvqmgDYH+fGTiQwrVkj7+hsB1OfFGHc8ViFNk2Y9CIK8sS5+Tr6HAHVnA2c='}
2023-12-20T04:14:44.871 DEBUG:teuthology.nuke:shortname: smithi196
2023-12-20T04:14:44.872 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:14:44.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:43.563421', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZwtQpxKTpLSn+a65/JCA+t0xKQ2vhimBRLeZgo+B6E+7nscUgYKcn9oCo4C7BUGIiLutN7UZQMT3KG5ujhVd0='}
2023-12-20T04:14:44.933 INFO:teuthology.orchestra.console.smithi194:Power off
2023-12-20T04:14:44.933 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:14:44.968 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-12-20T04:14:44.968 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:14:44.991 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-20T04:14:44.992 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:14:45.006 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-12-20T04:14:45.028 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-20T04:14:45.028 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:14:45.061 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-20T04:14:45.107 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-12-20T04:14:45.162 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-20T04:14:45.263 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com
2023-12-20T04:14:45.312 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com