2023-12-19T18:40:09.460 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T18:40:09.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:40:09.589 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc0f28bc2e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc0f3817940>, signals=[15])
2023-12-19T18:40:09.589 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-12-19T18:40:09.589 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:40:09.589 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-12-19T18:40:09.614 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-12-19T18:40:09.614 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T18:40:09.615 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-12-19T18:40:09.726 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T18:40:09.735 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T18:40:09.774 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6
2023-12-19T18:40:09.777 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6
2023-12-19T18:40:10.063 INFO:teuthology.orchestra.console.smithi088:Power off
2023-12-19T18:40:10.064 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:40:10.076 INFO:teuthology.orchestra.console.smithi099:Power off
2023-12-19T18:40:10.076 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:40:10.088 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-12-19T18:40:10.089 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:10.097 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-12-19T18:40:10.097 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:10.110 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-19T18:40:10.119 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-12-19T18:40:14.115 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:14.121 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:14.224 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-19T18:40:14.230 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-12-19T18:40:18.225 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:18.233 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:18.336 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-19T18:40:18.342 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-12-19T18:40:22.337 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.347 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.449 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-19T18:40:22.455 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-12-19T18:40:22.551 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-12-19T18:40:22.556 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-12-19T18:40:22.652 INFO:teuthology.orchestra.console.smithi088:Power on
2023-12-19T18:40:22.652 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:40:22.659 INFO:teuthology.orchestra.console.smithi099:Power on
2023-12-19T18:40:22.659 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T18:40:22.674 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2023-12-19T18:40:22.674 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.683 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-12-19T18:40:22.684 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:22.697 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-19T18:40:22.709 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-12-19T18:40:26.701 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:26.710 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:40:26.811 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-19T18:40:26.820 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-12-19T18:40:26.912 INFO:teuthology.orchestra.console.smithi088:Power on completed
2023-12-19T18:40:26.921 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-12-19T18:40:27.014 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-12-19T18:40:27.024 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-12-19T18:43:13.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:16.273 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:43:22.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:25.329 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:43:28.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:31.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:31.346 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:43:34.385 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:43:37.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:40.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:40.405 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:43:43.441 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:43:46.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:49.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:49.489 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:43:52.498 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:43:55.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:43:58.549 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:43:58.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:01.617 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-12-19T18:44:04.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:07.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:07.633 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:44:13.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:16.725 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:44:22.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:25.810 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:44:31.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:44:34.898 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-19T18:44:40.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:07.650 WARNING:teuthology.provision.fog.smithi099:timed out
2023-12-19T18:45:13.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:13.898 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:45:13.898 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:45:14.157 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-12-19T18:45:14.157 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-12-19T18:45:14.175 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-12-19T18:45:14.176 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-12-19T18:45:14.234 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-12-19T18:45:14.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-12-19T18:45:14.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-12-19T18:45:14.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-12-19T18:45:14.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-12-19T18:45:14.534 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-12-19T18:45:14.602 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:45:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:45:14.660 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:45:14.661 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-12-19T18:45:14.663 DEBUG:teuthology.parallel:result is None
2023-12-19T18:45:40.930 WARNING:teuthology.provision.fog.smithi088:timed out
2023-12-19T18:45:46.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:47.195 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T18:45:47.195 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T18:45:47.458 INFO:teuthology.provision.fog.smithi088:Node is ready
2023-12-19T18:45:47.459 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2023-12-19T18:45:47.478 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088
2023-12-19T18:45:47.478 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088 /etc/hosts
2023-12-19T18:45:47.539 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2023-12-19T18:45:47.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-12-19T18:45:47.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hosts
2023-12-19T18:45:47.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2023-12-19T18:45:47.758 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hostname
2023-12-19T18:45:47.826 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-12-19T18:45:47.893 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-12-19T18:45:47.950 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:45:47.950 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:45:47.950 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-12-19T18:45:47.950 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:45:47.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:45:47.952 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2023-12-19T18:45:47.952 DEBUG:teuthology.parallel:result is None
2023-12-19T18:45:48.118 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2023-12-19T18:45:48.119 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:45:48.144 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-12-19T18:45:48.144 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T18:45:48.161 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:45:48.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-12-19T18:45:48.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:48.228 DEBUG:teuthology.orchestra.run.smithi088:> true
2023-12-19T18:45:48.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-12-19T18:45:48.294 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2023-12-19T18:45:48.350 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2023-12-19T18:45:48.350 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:48.408 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:45:48.409 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:45:48.410 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-12-19T18:45:48.426 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-12-19T18:45:48.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-12-19T18:45:48.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T18:45:48.495 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-12-19T18:45:48.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-12-19T18:45:48.631 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-12-19T18:45:48.689 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-12-19T18:45:48.690 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-12-19T18:45:48.747 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T18:45:48.748 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T18:45:48.749 INFO:teuthology.orchestra.run.smithi099.stdout:
2023-12-19T18:45:48.749 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T18:45:48.749 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T18:45:48.749 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T18:45:48.749 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T18:45:48.749 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-12-19T18:45:48.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:45:48.862 INFO:teuthology.dispatcher.supervisor:Running job 7497312
2023-12-19T18:45:48.862 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497312 --name yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497312/orig.config.yaml
2023-12-19T18:45:48.865 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497312
2023-12-19T18:45:48.866 INFO:teuthology.dispatcher.supervisor:Job PID: 1650118
2023-12-19T18:45:48.866 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T18:47:48.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:49:49.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:51:49.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:53:49.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T18:53:49.537 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T18:53:49.647 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T18:53:49.647 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T18:53:49.693 DEBUG:teuthology.nuke:shortname: smithi088
2023-12-19T18:53:49.694 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T18:53:49.717 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:40:08.610790', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjP948WDrWqx7AjN+yTBCb/jwCyDm3p6RYeL8eJxQaUYJ5ZvMaNiRHrU2TFj1Jn4H6I6H9lQgxirwTDmYLx6PM='}
2023-12-19T18:53:49.721 DEBUG:teuthology.nuke:shortname: smithi099
2023-12-19T18:53:49.721 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T18:53:49.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:40:08.609295', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHEcDOJhXnMqhePd13NNrD6UJYOs27e7yzTe4+7G1nwt2ww0+9sAlBEKRGxVVVPN40Y9ZYFVlMWr3zbDNJ3KYBI='}
2023-12-19T18:53:49.780 INFO:teuthology.orchestra.console.smithi088:Power off
2023-12-19T18:53:49.780 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:53:49.817 INFO:teuthology.orchestra.console.smithi099:Power off
2023-12-19T18:53:49.817 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T18:53:49.831 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-12-19T18:53:49.831 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:53:49.849 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-12-19T18:53:49.849 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T18:53:49.858 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-19T18:53:49.870 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-12-19T18:53:49.960 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-12-19T18:53:49.971 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-12-19T18:53:50.114 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-12-19T18:53:50.127 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com