2024-01-24T15:55:31.616 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T15:55:31.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T15:55:31.779 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fee9a013f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fee9b079c10>, signals=[15])
2024-01-24T15:55:31.779 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2024-01-24T15:55:31.779 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T15:55:31.780 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-24T15:55:31.803 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2024-01-24T15:55:31.803 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T15:55:31.803 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2024-01-24T15:55:31.827 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-01-24T15:55:31.827 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T15:55:31.827 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-24T15:55:31.921 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T15:55:31.948 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T15:55:31.952 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T15:55:31.971 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6
2024-01-24T15:55:32.002 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6
2024-01-24T15:55:32.004 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6
2024-01-24T15:55:32.185 INFO:teuthology.orchestra.console.smithi124:Power off
2024-01-24T15:55:32.185 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T15:55:32.209 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2024-01-24T15:55:32.209 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:32.231 INFO:teuthology.orchestra.console.smithi137:Power off
2024-01-24T15:55:32.232 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T15:55:32.245 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-24T15:55:32.245 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T15:55:32.253 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-24T15:55:32.254 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2024-01-24T15:55:32.254 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:32.268 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-24T15:55:32.268 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:32.277 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2024-01-24T15:55:32.289 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-24T15:55:36.256 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:36.278 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:36.290 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:36.365 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-24T15:55:36.386 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2024-01-24T15:55:36.398 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-24T15:55:40.370 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:40.386 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:40.399 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:40.479 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-24T15:55:40.495 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2024-01-24T15:55:40.507 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-24T15:55:40.608 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-24T15:55:40.708 INFO:teuthology.orchestra.console.smithi153:Power on
2024-01-24T15:55:40.708 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T15:55:40.731 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-01-24T15:55:40.731 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:40.756 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-24T15:55:44.484 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:44.496 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:44.594 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-24T15:55:44.605 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2024-01-24T15:55:44.695 INFO:teuthology.orchestra.console.smithi124:Power off completed
2024-01-24T15:55:44.706 INFO:teuthology.orchestra.console.smithi137:Power off completed
2024-01-24T15:55:44.758 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:44.796 INFO:teuthology.orchestra.console.smithi124:Power on
2024-01-24T15:55:44.797 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T15:55:44.807 INFO:teuthology.orchestra.console.smithi137:Power on
2024-01-24T15:55:44.807 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T15:55:44.819 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2024-01-24T15:55:44.819 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:44.827 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On
2024-01-24T15:55:44.828 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:44.840 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-24T15:55:44.848 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2024-01-24T15:55:44.866 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-24T15:55:48.844 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:48.851 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:48.866 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T15:55:48.952 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-24T15:55:48.960 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2024-01-24T15:55:48.976 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-24T15:55:49.054 INFO:teuthology.orchestra.console.smithi124:Power on completed
2024-01-24T15:55:49.060 INFO:teuthology.orchestra.console.smithi137:Power on completed
2024-01-24T15:55:49.077 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-01-24T15:55:49.155 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2024-01-24T15:55:49.161 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2024-01-24T15:55:49.178 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-01-24T15:58:35.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:35.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:35.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:35.307 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-24T15:58:38.272 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:58:38.300 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:58:44.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:44.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:47.324 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:58:47.356 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:58:53.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:53.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:58:56.380 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:58:56.416 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:59:02.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:02.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:05.436 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:59:05.472 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:59:11.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:11.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:13.984 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-24T15:59:14.492 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:59:14.524 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:59:19.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:20.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:20.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:23.040 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-24T15:59:23.552 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:59:23.584 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-24T15:59:29.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:29.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:29.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:32.127 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-24T15:59:32.604 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2024-01-24T15:59:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:38.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T15:59:41.180 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-24T15:59:47.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:29.588 WARNING:teuthology.provision.fog.smithi124:timed out
2024-01-24T16:00:35.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:35.828 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T16:00:35.829 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T16:00:36.104 INFO:teuthology.provision.fog.smithi124:Node is ready
2024-01-24T16:00:36.104 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2024-01-24T16:00:36.123 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124
2024-01-24T16:00:36.124 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124 /etc/hosts
2024-01-24T16:00:36.183 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2024-01-24T16:00:36.183 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-24T16:00:36.302 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hosts
2024-01-24T16:00:36.335 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2024-01-24T16:00:36.407 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hostname
2024-01-24T16:00:36.480 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-24T16:00:36.552 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:36.612 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:36.613 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:36.614 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2024-01-24T16:00:36.615 DEBUG:teuthology.parallel:result is None
2024-01-24T16:00:38.607 WARNING:teuthology.provision.fog.smithi137:timed out
2024-01-24T16:00:44.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:44.863 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T16:00:44.864 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T16:00:45.136 INFO:teuthology.provision.fog.smithi137:Node is ready
2024-01-24T16:00:45.136 DEBUG:teuthology.orchestra.run.smithi137:> hostname
2024-01-24T16:00:45.154 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137
2024-01-24T16:00:45.155 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137 /etc/hosts
2024-01-24T16:00:45.214 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2024-01-24T16:00:45.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2024-01-24T16:00:45.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hosts
2024-01-24T16:00:45.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts
2024-01-24T16:00:45.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137/smithi137/g' /etc/hostname
2024-01-24T16:00:45.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2024-01-24T16:00:45.579 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2024-01-24T16:00:45.636 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:45.637 INFO:teuthology.orchestra.run.smithi137.stdout:
2024-01-24T16:00:45.638 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:45.638 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:45.638 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:45.638 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:45.638 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2024-01-24T16:00:45.639 DEBUG:teuthology.parallel:result is None
2024-01-24T16:00:47.183 WARNING:teuthology.provision.fog.smithi153:timed out
2024-01-24T16:00:53.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:53.388 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T16:00:53.388 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T16:00:53.637 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-01-24T16:00:53.637 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-01-24T16:00:53.654 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-01-24T16:00:53.654 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-01-24T16:00:53.711 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-01-24T16:00:53.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-24T16:00:53.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-01-24T16:00:53.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-01-24T16:00:53.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-01-24T16:00:53.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-24T16:00:54.061 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-24T16:00:54.118 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:54.119 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:54.120 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:54.120 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:54.120 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-01-24T16:00:54.120 DEBUG:teuthology.parallel:result is None
2024-01-24T16:00:54.309 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2024-01-24T16:00:54.309 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T16:00:54.338 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2024-01-24T16:00:54.338 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T16:00:54.355 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-01-24T16:00:54.355 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T16:00:54.381 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2024-01-24T16:00:54.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-24T16:00:54.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:54.454 DEBUG:teuthology.orchestra.run.smithi124:> true
2024-01-24T16:00:54.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-24T16:00:54.591 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2024-01-24T16:00:54.651 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2024-01-24T16:00:54.651 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel"
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora"
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6"
2024-01-24T16:00:54.709 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:54.710 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:54.711 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-24T16:00:54.739 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2024-01-24T16:00:54.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2024-01-24T16:00:54.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:54.811 DEBUG:teuthology.orchestra.run.smithi137:> true
2024-01-24T16:00:54.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com'
2024-01-24T16:00:54.883 DEBUG:teuthology.orchestra.run.smithi137:> uname -m
2024-01-24T16:00:54.942 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2024-01-24T16:00:54.942 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:55.001 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:55.002 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:55.002 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2024-01-24T16:00:55.022 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-01-24T16:00:55.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-24T16:00:55.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T16:00:55.091 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-01-24T16:00:55.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-24T16:00:55.118 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-01-24T16:00:55.177 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-01-24T16:00:55.177 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T16:00:55.236 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T16:00:55.237 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T16:00:55.237 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-24T16:00:55.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:00:55.341 INFO:teuthology.dispatcher.supervisor:Running job 7530935
2024-01-24T16:00:55.342 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935 --name vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935/orig.config.yaml
2024-01-24T16:00:55.344 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935
2024-01-24T16:00:55.344 INFO:teuthology.dispatcher.supervisor:Job PID: 3701545
2024-01-24T16:00:55.344 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T16:02:55.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:04:55.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:06:55.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:08:55.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:10:55.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:12:55.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:14:55.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:16:55.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:18:55.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:20:55.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:22:56.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T16:22:56.103 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T16:22:56.253 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T16:22:56.253 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T16:22:56.308 DEBUG:teuthology.nuke:shortname: smithi124
2024-01-24T16:22:56.309 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T16:22:56.328 DEBUG:teuthology.nuke:shortname: smithi137
2024-01-24T16:22:56.329 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T16:22:56.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:55:30.546837', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOI1mJlPKl1B/bKxye0suLYpxbheeuvAsjQFt9mZhPaWKOjEM+NzuhwQ9jumBJ6nlTmC/2nlWB6Wr8XPVseUCSs='}
2024-01-24T16:22:56.343 DEBUG:teuthology.nuke:shortname: smithi153
2024-01-24T16:22:56.344 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T16:22:56.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:55:30.548420', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEY+Avm1fyJPTUOvHnxGRGtOeEbV210Ck+xtJ0e8KVKNI3GcNoCguXRHOCxetAkQHYdObwL2OZadHu1WJa6Ar2g='}
2024-01-24T16:22:56.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:55:30.549772', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBGXtYqMtqQ0hnb6EnF61tALvm0nFq82nulLPtyX2IBTVf1jhSINk+kDr9Q87xtusE+Or6/oyKoQjiE7zMI0g4='}
2024-01-24T16:22:56.376 INFO:teuthology.orchestra.console.smithi124:Power off
2024-01-24T16:22:56.376 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T16:22:56.399 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2024-01-24T16:22:56.400 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T16:22:56.415 INFO:teuthology.orchestra.console.smithi137:Power off
2024-01-24T16:22:56.416 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T16:22:56.428 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-24T16:22:56.429 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T16:22:56.436 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-24T16:22:56.438 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2024-01-24T16:22:56.439 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T16:22:56.450 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-24T16:22:56.450 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T16:22:56.460 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2024-01-24T16:22:56.471 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-24T16:22:56.537 INFO:teuthology.orchestra.console.smithi124:Power off completed
2024-01-24T16:22:56.562 INFO:teuthology.orchestra.console.smithi137:Power off completed
2024-01-24T16:22:56.572 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-24T16:22:56.699 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2024-01-24T16:22:56.707 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2024-01-24T16:22:56.716 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com