2023-12-13T11:46:14.649 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-13T11:46:14.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T11:46:14.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f605ba082b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f605c961940>, signals=[15])
2023-12-13T11:46:14.805 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2023-12-13T11:46:14.805 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T11:46:14.806 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-12-13T11:46:14.827 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2023-12-13T11:46:14.828 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2023-12-13T11:46:14.828 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-12-13T11:46:14.936 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-13T11:46:14.965 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-13T11:46:14.977 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.4
2023-12-13T11:46:15.012 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.4
2023-12-13T11:46:15.226 INFO:teuthology.orchestra.console.smithi102:Power off
2023-12-13T11:46:15.226 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T11:46:15.254 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-12-13T11:46:15.254 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:15.275 INFO:teuthology.orchestra.console.smithi134:Power off
2023-12-13T11:46:15.275 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T11:46:15.289 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-12-13T11:46:15.302 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2023-12-13T11:46:15.303 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:15.335 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-12-13T11:46:19.290 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:19.336 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:19.400 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-12-13T11:46:19.445 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-12-13T11:46:23.402 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:23.446 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:23.512 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-12-13T11:46:23.555 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-12-13T11:46:23.612 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-12-13T11:46:23.656 INFO:teuthology.orchestra.console.smithi134:Power off completed
2023-12-13T11:46:23.713 INFO:teuthology.orchestra.console.smithi102:Power on
2023-12-13T11:46:23.714 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T11:46:23.735 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2023-12-13T11:46:23.736 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:23.757 INFO:teuthology.orchestra.console.smithi134:Power on
2023-12-13T11:46:23.757 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-13T11:46:23.773 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-12-13T11:46:23.787 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2023-12-13T11:46:23.788 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:23.809 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-12-13T11:46:27.774 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:27.810 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:27.883 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-12-13T11:46:27.921 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-12-13T11:46:31.887 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:31.922 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T11:46:31.997 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-12-13T11:46:32.080 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-12-13T11:46:32.098 INFO:teuthology.orchestra.console.smithi102:Power on completed
2023-12-13T11:46:32.181 INFO:teuthology.orchestra.console.smithi134:Power on completed
2023-12-13T11:46:32.200 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2023-12-13T11:46:32.282 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2023-12-13T11:49:18.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:18.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:21.094 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:49:21.095 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:49:27.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:27.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:30.178 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:49:30.179 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:49:36.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:36.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:39.234 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:49:39.235 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:49:45.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:45.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:48.290 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:49:48.290 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:49:54.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:54.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:49:57.350 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:49:57.378 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:50:03.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:03.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:06.434 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-12-13T11:50:06.435 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:50:12.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:12.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:31.014 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:50:37.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:40.098 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:50:46.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:49.154 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-12-13T11:50:55.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:50:55.876 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T11:50:55.877 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T11:51:11.748 INFO:teuthology.provision.fog.smithi134:Node is ready
2023-12-13T11:51:11.749 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2023-12-13T11:51:11.765 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2023-12-13T11:51:11.765 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2023-12-13T11:51:11.820 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2023-12-13T11:51:11.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-12-13T11:51:12.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2023-12-13T11:51:12.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2023-12-13T11:51:12.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2023-12-13T11:51:12.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-12-13T11:51:12.231 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-12-13T11:51:12.286 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:
2023-12-13T11:51:12.287 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T11:51:12.288 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T11:51:12.288 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T11:51:12.288 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T11:51:12.288 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2023-12-13T11:51:12.290 DEBUG:teuthology.parallel:result is None
2023-12-13T11:51:12.441 WARNING:teuthology.provision.fog.smithi102:timed out
2023-12-13T11:51:18.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:51:18.794 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-13T11:51:18.795 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-13T11:51:19.054 INFO:teuthology.provision.fog.smithi102:Node is ready
2023-12-13T11:51:19.055 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2023-12-13T11:51:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2023-12-13T11:51:19.074 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2023-12-13T11:51:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2023-12-13T11:51:19.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-12-13T11:51:19.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2023-12-13T11:51:19.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2023-12-13T11:51:19.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2023-12-13T11:51:19.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-12-13T11:51:19.479 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-12-13T11:51:19.534 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T11:51:19.534 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T11:51:19.534 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T11:51:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T11:51:19.536 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T11:51:19.536 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2023-12-13T11:51:19.536 DEBUG:teuthology.parallel:result is None
2023-12-13T11:51:19.697 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2023-12-13T11:51:19.697 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T11:51:19.725 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2023-12-13T11:51:19.725 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-13T11:51:19.751 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2023-12-13T11:51:19.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-12-13T11:51:19.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:51:19.817 DEBUG:teuthology.orchestra.run.smithi102:> true
2023-12-13T11:51:19.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-12-13T11:51:19.881 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2023-12-13T11:51:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2023-12-13T11:51:19.935 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-12-13T11:51:19.989 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T11:51:19.989 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T11:51:19.990 INFO:teuthology.orchestra.run.smithi102.stdout:
2023-12-13T11:51:19.991 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T11:51:19.991 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T11:51:19.991 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T11:51:19.991 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T11:51:19.991 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-12-13T11:51:20.009 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2023-12-13T11:51:20.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-12-13T11:51:20.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-13T11:51:20.077 DEBUG:teuthology.orchestra.run.smithi134:> true
2023-12-13T11:51:20.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-12-13T11:51:20.147 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2023-12-13T11:51:20.203 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2023-12-13T11:51:20.203 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-12-13T11:51:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-13T11:51:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-13T11:51:20.261 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-12-13T11:51:20.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T11:51:20.375 INFO:teuthology.dispatcher.supervisor:Running job 7489650
2023-12-13T11:51:20.375 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489650 --name vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489650/orig.config.yaml
2023-12-13T11:51:20.379 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489650
2023-12-13T11:51:20.379 INFO:teuthology.dispatcher.supervisor:Job PID: 634776
2023-12-13T11:51:20.379 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-13T11:53:20.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T11:55:20.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T11:57:20.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T11:59:20.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T12:01:21.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T12:03:21.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-13T12:03:21.384 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-13T12:03:21.492 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-13T12:03:21.492 INFO:teuthology.nuke:Checking targets against current locks
2023-12-13T12:03:21.548 DEBUG:teuthology.nuke:shortname: smithi102
2023-12-13T12:03:21.548 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T12:03:21.569 DEBUG:teuthology.nuke:shortname: smithi134
2023-12-13T12:03:21.569 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-13T12:03:21.573 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489650', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 11:46:13.805225', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpm8AKYCJAohA/KECuLdFByjhamY+Ce6m9LBNALXZ+e/E8bRq2kPFKhxHVrbhILijDqv/dMl62qEIKp35EjpQk='}
2023-12-13T12:03:21.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-13_09:42:45-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-testing-default-smithi/7489650', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 11:46:13.803438', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGf+IKV8Ljr/CQgvsiTMR8G2x52ByC/hLQFS47Dvk68QZH7IY9StXx9TXI2BUR0gL4hHX7baAz5iqV+QLj/0fV0='}
2023-12-13T12:03:21.626 INFO:teuthology.orchestra.console.smithi102:Power off
2023-12-13T12:03:21.627 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T12:03:21.652 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-12-13T12:03:21.653 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T12:03:21.675 INFO:teuthology.orchestra.console.smithi134:Power off
2023-12-13T12:03:21.675 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-13T12:03:21.685 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-12-13T12:03:21.699 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2023-12-13T12:03:21.699 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-13T12:03:21.727 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-12-13T12:03:21.786 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-12-13T12:03:21.829 INFO:teuthology.orchestra.console.smithi134:Power off completed
2023-12-13T12:03:21.933 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2023-12-13T12:03:22.055 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com