2023-12-19T18:12:20.790 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T18:12:20.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:12:21.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe247284280>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe2481cc940>, signals=[15])
2023-12-19T18:12:21.011 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2023-12-19T18:12:21.011 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:12:21.011 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2023-12-19T18:12:21.043 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-12-19T18:12:21.043 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:12:21.043 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-19T18:12:21.083 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-12-19T18:12:21.083 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:12:21.083 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-19T18:12:21.225 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T18:12:21.264 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T18:12:21.290 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T18:12:21.300 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6
2023-12-19T18:12:21.320 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2023-12-19T18:12:21.361 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.6
2023-12-19T18:12:21.695 INFO:teuthology.orchestra.console.smithi063:Power off
2023-12-19T18:12:21.695 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:12:21.710 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-19T18:12:21.711 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:12:21.723 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-19T18:12:21.724 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:12:21.734 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2023-12-19T18:12:21.734 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:21.758 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-19T18:12:21.759 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:21.771 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-19T18:12:21.772 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:21.782 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-19T18:12:21.809 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-19T18:12:21.818 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-19T18:12:25.785 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:25.810 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:25.819 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:25.895 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-19T18:12:25.919 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-19T18:12:25.927 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-19T18:12:29.897 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:29.920 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:29.927 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:30.009 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-19T18:12:30.029 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-19T18:12:30.036 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-19T18:12:30.136 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-19T18:12:30.237 INFO:teuthology.orchestra.console.smithi196:Power on
2023-12-19T18:12:30.237 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:12:30.289 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-12-19T18:12:30.290 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:30.339 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-19T18:12:34.013 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:34.030 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:34.122 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-19T18:12:34.138 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-19T18:12:34.223 INFO:teuthology.orchestra.console.smithi063:Power off completed
2023-12-19T18:12:34.239 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-19T18:12:34.324 INFO:teuthology.orchestra.console.smithi063:Power on
2023-12-19T18:12:34.325 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:12:34.340 INFO:teuthology.orchestra.console.smithi161:Power on
2023-12-19T18:12:34.341 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:12:34.348 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:34.359 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2023-12-19T18:12:34.359 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:34.386 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-12-19T18:12:34.387 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:34.408 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-19T18:12:34.434 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-19T18:12:34.458 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-19T18:12:38.409 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:38.435 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:38.459 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:38.519 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-19T18:12:38.545 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-19T18:12:38.568 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-19T18:12:38.646 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-12-19T18:12:38.669 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-12-19T18:12:38.747 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-12-19T18:12:38.769 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-12-19T18:12:42.523 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:12:42.636 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2023-12-19T18:12:42.736 INFO:teuthology.orchestra.console.smithi063:Power on completed
2023-12-19T18:12:42.837 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2023-12-19T18:15:24.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:25.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:28.082 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:15:28.082 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:15:28.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:31.921 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:15:34.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:34.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:37.173 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:15:37.201 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:15:37.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:41.009 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:15:43.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:43.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:46.257 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:15:46.289 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:15:47.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:50.097 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:15:52.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:52.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:55.345 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:15:55.377 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:15:56.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:15:59.189 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:16:01.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:01.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:04.433 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:16:04.465 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:16:05.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:08.277 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:16:10.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:10.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:13.525 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-12-19T18:16:13.553 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:16:14.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:17.361 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:16:19.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:19.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:22.645 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-19T18:16:23.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:26.453 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2023-12-19T18:16:28.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:16:32.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:19.603 WARNING:teuthology.provision.fog.smithi196:timed out
2023-12-19T18:17:25.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:25.823 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:17:25.823 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:17:26.096 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-12-19T18:17:26.096 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-12-19T18:17:26.116 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196
2023-12-19T18:17:26.116 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196 /etc/hosts
2023-12-19T18:17:26.175 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-12-19T18:17:26.175 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-19T18:17:26.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hosts
2023-12-19T18:17:26.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-12-19T18:17:26.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196/smithi196/g' /etc/hostname
2023-12-19T18:17:26.474 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-12-19T18:17:26.543 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-19T18:17:26.600 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:26.600 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:26.601 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:26.602 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:26.602 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-12-19T18:17:26.603 DEBUG:teuthology.parallel:result is None
2023-12-19T18:17:28.677 WARNING:teuthology.provision.fog.smithi161:timed out
2023-12-19T18:17:32.472 WARNING:teuthology.provision.fog.smithi063:timed out
2023-12-19T18:17:34.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:34.996 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:17:34.996 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:17:35.263 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-12-19T18:17:35.263 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-12-19T18:17:35.281 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-12-19T18:17:35.281 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-12-19T18:17:35.340 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-12-19T18:17:35.340 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-19T18:17:35.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-12-19T18:17:35.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-12-19T18:17:35.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-12-19T18:17:35.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-19T18:17:35.707 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-19T18:17:35.764 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:35.764 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:35.765 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-12-19T18:17:35.765 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-12-19T18:17:35.765 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:35.766 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:35.767 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-12-19T18:17:35.767 DEBUG:teuthology.parallel:result is None
2023-12-19T18:17:38.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:38.705 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:17:38.705 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:17:38.972 INFO:teuthology.provision.fog.smithi063:Node is ready
2023-12-19T18:17:38.972 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2023-12-19T18:17:38.991 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2023-12-19T18:17:38.991 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2023-12-19T18:17:39.048 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2023-12-19T18:17:39.048 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2023-12-19T18:17:39.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2023-12-19T18:17:39.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2023-12-19T18:17:39.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2023-12-19T18:17:39.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2023-12-19T18:17:39.393 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2023-12-19T18:17:39.451 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:39.451 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:39.451 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:39.452 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:39.453 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:39.454 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2023-12-19T18:17:39.454 DEBUG:teuthology.parallel:result is None
2023-12-19T18:17:39.862 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2023-12-19T18:17:39.862 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:17:39.895 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-12-19T18:17:39.895 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:17:39.919 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-12-19T18:17:39.920 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:17:39.946 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:17:39.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2023-12-19T18:17:39.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:40.020 DEBUG:teuthology.orchestra.run.smithi063:> true
2023-12-19T18:17:40.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2023-12-19T18:17:40.087 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2023-12-19T18:17:40.144 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2023-12-19T18:17:40.145 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2023-12-19T18:17:40.199 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:40.201 INFO:teuthology.orchestra.run.smithi063.stdout:
2023-12-19T18:17:40.201 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:40.201 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:40.201 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:40.201 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:40.201 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2023-12-19T18:17:40.237 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:17:40.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-19T18:17:40.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:40.311 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-12-19T18:17:40.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-19T18:17:40.385 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-12-19T18:17:40.446 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-12-19T18:17:40.446 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-19T18:17:40.504 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:40.505 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-12-19T18:17:40.506 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:40.506 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:40.506 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:40.506 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:40.506 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-19T18:17:40.545 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:17:40.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-19T18:17:40.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:17:40.622 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-12-19T18:17:40.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-12-19T18:17:40.759 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-12-19T18:17:40.817 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-12-19T18:17:40.817 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:17:40.875 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:17:40.876 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-12-19T18:17:40.876 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:17:40.876 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:17:40.876 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:17:40.876 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:17:40.876 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-19T18:17:40.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:17:41.026 INFO:teuthology.dispatcher.supervisor:Running job 7497257
2023-12-19T18:17:41.026 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257 --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257/orig.config.yaml
2023-12-19T18:17:41.030 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257
2023-12-19T18:17:41.030 INFO:teuthology.dispatcher.supervisor:Job PID: 1259223
2023-12-19T18:17:41.030 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T18:19:41.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:21:41.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:23:41.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:25:41.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:27:41.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:29:41.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:31:42.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:33:42.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:33:42.364 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T18:33:42.520 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T18:33:42.521 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T18:33:42.571 DEBUG:teuthology.nuke:shortname: smithi063
2023-12-19T18:33:42.571 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T18:33:42.599 DEBUG:teuthology.nuke:shortname: smithi161
2023-12-19T18:33:42.600 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T18:33:42.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:12:19.766681', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFn1ro/FpqrkyQxwqI6LKGSDroOvmy5PzEAwl/t9IQdecyHbnAisMFGsEXX3iFQiWd81r4pdbEnqwhP8jZCa+dE='}
2023-12-19T18:33:42.619 DEBUG:teuthology.nuke:shortname: smithi196
2023-12-19T18:33:42.619 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T18:33:42.626 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:12:19.770069', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9A5jbCczmIMwG4/ONJgOEiQffrfNgcVza3B1P39Xeci/VJXUgGyL32ygCefKz8XQUJlqfQc5s2QHTkXfy8N4Y='}
2023-12-19T18:33:42.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497257', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:12:19.768987', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpDrziCB4bS1YHO3MTmVAWYlP8MAYZTK8aWDIdZpTa6nK+9nNveYGNxEzibX/lyBY/W7/1OBNdihC8sf2zyGqU='}
2023-12-19T18:33:42.656 INFO:teuthology.orchestra.console.smithi063:Power off
2023-12-19T18:33:42.657 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:33:42.679 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2023-12-19T18:33:42.679 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:33:42.699 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-19T18:33:42.699 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:33:42.715 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-19T18:33:42.716 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:33:42.722 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2023-12-19T18:33:42.724 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-19T18:33:42.724 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:33:42.738 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-19T18:33:42.739 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:33:42.748 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-19T18:33:42.761 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-19T18:33:42.824 INFO:teuthology.orchestra.console.smithi063:Power off completed
2023-12-19T18:33:42.850 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-19T18:33:42.862 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-19T18:33:42.981 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com
2023-12-19T18:33:43.002 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-12-19T18:33:43.011 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com