2024-01-08T07:59:51.278 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-08T07:59:51.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T07:59:51.420 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f17a635c2e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f17a7274940>, signals=[15])
2024-01-08T07:59:51.421 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2024-01-08T07:59:51.421 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2024-01-08T07:59:51.421 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2024-01-08T07:59:51.441 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging
2024-01-08T07:59:51.442 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server
2024-01-08T07:59:51.442 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-01-08T07:59:51.553 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-08T07:59:51.580 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-08T07:59:51.610 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6
2024-01-08T07:59:51.627 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of rhel 8.6
2024-01-08T07:59:51.865 INFO:teuthology.orchestra.console.smithi007:Power off
2024-01-08T07:59:51.865 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T07:59:51.886 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2024-01-08T07:59:51.886 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:51.906 INFO:teuthology.orchestra.console.smithi069:Power off
2024-01-08T07:59:51.907 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T07:59:51.915 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2024-01-08T07:59:51.929 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2024-01-08T07:59:51.930 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:51.953 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-08T07:59:52.016 INFO:teuthology.orchestra.console.smithi007:Power off completed
2024-01-08T07:59:52.054 INFO:teuthology.orchestra.console.smithi069:Power off completed
2024-01-08T07:59:52.117 INFO:teuthology.orchestra.console.smithi007:Power on
2024-01-08T07:59:52.117 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-08T07:59:52.142 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On
2024-01-08T07:59:52.142 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:52.155 INFO:teuthology.orchestra.console.smithi069:Power on
2024-01-08T07:59:52.156 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-08T07:59:52.165 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2024-01-08T07:59:52.177 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On
2024-01-08T07:59:52.177 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:52.200 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-08T07:59:56.168 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:56.201 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T07:59:56.277 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2024-01-08T07:59:56.311 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-08T07:59:56.378 INFO:teuthology.orchestra.console.smithi007:Power on completed
2024-01-08T07:59:56.479 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2024-01-08T08:00:00.312 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:00:00.421 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-01-08T08:00:00.522 INFO:teuthology.orchestra.console.smithi069:Power on completed
2024-01-08T08:00:00.622 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish
2024-01-08T08:02:27.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:02:27.455 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-08T08:02:46.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:02:49.532 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:02:55.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:02:58.592 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:03:04.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:07.676 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:03:13.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:16.736 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:03:22.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:25.792 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:03:31.461 WARNING:teuthology.provision.fog.smithi007:timed out
2024-01-08T08:03:31.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:34.848 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-08T08:03:37.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:40.544 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2024-01-08T08:03:40.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:46.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:49.596 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2024-01-08T08:03:55.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:03:58.656 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2024-01-08T08:04:04.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:04:04.899 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-08T08:04:04.899 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-08T08:04:20.594 INFO:teuthology.provision.fog.smithi007:Node is ready
2024-01-08T08:04:20.594 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2024-01-08T08:04:20.616 INFO:teuthology.orchestra.run.smithi007.stdout:smithi045
2024-01-08T08:04:20.617 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi045 /etc/hosts
2024-01-08T08:04:20.678 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-01-08T08:04:20.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi045/smithi007/g' /etc/hostname
2024-01-08T08:04:20.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2024-01-08T08:04:20.845 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2024-01-08T08:04:20.907 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:04:20.908 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:04:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:
2024-01-08T08:04:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:04:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:04:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:04:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:04:20.910 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2024-01-08T08:04:20.911 DEBUG:teuthology.parallel:result is None
2024-01-08T08:04:40.852 WARNING:teuthology.provision.fog.smithi069:timed out
2024-01-08T08:04:46.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:04:47.088 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-08T08:04:47.088 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-08T08:04:47.356 INFO:teuthology.provision.fog.smithi069:Node is ready
2024-01-08T08:04:47.356 DEBUG:teuthology.orchestra.run.smithi069:> hostname
2024-01-08T08:04:47.415 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com
2024-01-08T08:04:47.415 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts
2024-01-08T08:04:47.473 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069
2024-01-08T08:04:47.474 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-01-08T08:04:47.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts
2024-01-08T08:04:47.616 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts
2024-01-08T08:04:47.684 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname
2024-01-08T08:04:47.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-01-08T08:04:47.819 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:04:47.876 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:04:47.877 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:04:47.877 INFO:teuthology.provision.fog.smithi069:Deploy complete!
2024-01-08T08:04:47.878 DEBUG:teuthology.parallel:result is None
2024-01-08T08:04:48.033 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2024-01-08T08:04:48.033 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-08T08:04:48.058 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com
2024-01-08T08:04:48.058 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-08T08:04:48.084 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2024-01-08T08:04:48.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2024-01-08T08:04:48.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:04:48.154 DEBUG:teuthology.orchestra.run.smithi007:> true
2024-01-08T08:04:48.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com'
2024-01-08T08:04:48.305 DEBUG:teuthology.orchestra.run.smithi007:> uname -m
2024-01-08T08:04:48.367 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2024-01-08T08:04:48.367 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:04:48.428 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:04:48.429 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:04:48.429 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2024-01-08T08:04:48.450 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server
2024-01-08T08:04:48.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-01-08T08:04:48.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:04:48.516 DEBUG:teuthology.orchestra.run.smithi069:> true
2024-01-08T08:04:48.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-01-08T08:04:48.585 DEBUG:teuthology.orchestra.run.smithi069:> uname -m
2024-01-08T08:04:48.641 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64
2024-01-08T08:04:48.642 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-01-08T08:04:48.698 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.6"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:04:48.699 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:04:48.700 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:04:48.700 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:04:48.700 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-01-08T08:04:48.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:04:48.817 INFO:teuthology.dispatcher.supervisor:Running job 7508970
2024-01-08T08:04:48.817 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508970 --name vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508970/orig.config.yaml
2024-01-08T08:04:48.820 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508970
2024-01-08T08:04:48.821 INFO:teuthology.dispatcher.supervisor:Job PID: 765948
2024-01-08T08:04:48.821 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-08T08:06:48.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:08:48.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:10:48.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:12:49.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:14:49.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:14:49.200 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-08T08:14:49.321 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-08T08:14:49.322 INFO:teuthology.nuke:Checking targets against current locks
2024-01-08T08:14:49.371 DEBUG:teuthology.nuke:shortname: smithi007
2024-01-08T08:14:49.371 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-08T08:14:49.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 07:59:50.402773', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEaX3ekVckNIC5Ik4l9n3n49u4gIqovrnJEowavvJUvKu6pi8DGCXYvr9kjr1cnSas3hKer6wiA19gVmNP+AHE='}
2024-01-08T08:14:49.399 DEBUG:teuthology.nuke:shortname: smithi069
2024-01-08T08:14:49.400 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-08T08:14:49.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7508970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 07:59:50.404771', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHKzowIWYzewJOey7i9p0imwvt+QU6K9U2fxZZ2WtAxGFCU+TCdzC25XFD0u/UnJDQhtC/5RbnArQDq2OFTkFs='}
2024-01-08T08:14:49.454 INFO:teuthology.orchestra.console.smithi007:Power off
2024-01-08T08:14:49.454 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T08:14:49.477 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2024-01-08T08:14:49.477 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:14:49.495 INFO:teuthology.orchestra.console.smithi069:Power off
2024-01-08T08:14:49.496 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T08:14:49.508 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2024-01-08T08:14:49.521 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2024-01-08T08:14:49.521 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:14:49.545 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-08T08:14:49.609 INFO:teuthology.orchestra.console.smithi007:Power off completed
2024-01-08T08:14:49.647 INFO:teuthology.orchestra.console.smithi069:Power off completed
2024-01-08T08:14:49.765 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2024-01-08T08:14:49.797 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com