2023-12-19T11:43:21.640 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T11:43:21.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:43:21.785 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fae869c72b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fae87924940>, signals=[15])
2023-12-19T11:43:21.786 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2023-12-19T11:43:21.786 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T11:43:21.786 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-19T11:43:21.815 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-12-19T11:43:21.815 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T11:43:21.815 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-12-19T11:43:21.940 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-19T11:43:21.949 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-19T11:43:21.988 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.4
2023-12-19T11:43:21.999 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of rhel 8.4
2023-12-19T11:43:22.237 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-19T11:43:22.237 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T11:43:22.262 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-19T11:43:22.262 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:22.278 INFO:teuthology.orchestra.console.smithi203:Power off
2023-12-19T11:43:22.278 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T11:43:22.286 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-19T11:43:22.300 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-12-19T11:43:22.300 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:22.322 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-19T11:43:22.388 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-19T11:43:22.424 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-12-19T11:43:22.489 INFO:teuthology.orchestra.console.smithi183:Power on
2023-12-19T11:43:22.490 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T11:43:22.513 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2023-12-19T11:43:22.513 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:22.525 INFO:teuthology.orchestra.console.smithi203:Power on
2023-12-19T11:43:22.525 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T11:43:22.539 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-19T11:43:22.548 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-12-19T11:43:22.548 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:22.574 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-19T11:43:26.541 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:26.575 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:26.651 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-19T11:43:26.684 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-19T11:43:30.654 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:30.686 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T11:43:30.795 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-12-19T11:43:30.875 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-12-19T11:43:30.896 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-12-19T11:43:30.976 INFO:teuthology.orchestra.console.smithi183:Power on completed
2023-12-19T11:43:30.997 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-12-19T11:43:31.077 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2023-12-19T11:46:17.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:17.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:35.666 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:46:35.666 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-19T11:46:41.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:41.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:44.758 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:46:44.758 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-19T11:46:50.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:50.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:53.842 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:46:53.842 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-19T11:46:59.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:46:59.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:47:02.897 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:47:02.929 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-19T11:47:08.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:47:08.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:47:11.986 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:47:17.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:47:21.041 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-12-19T11:47:27.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:48:08.974 WARNING:teuthology.provision.fog.smithi183:timed out
2023-12-19T11:48:14.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:48:15.319 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T11:48:15.319 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T11:48:15.570 INFO:teuthology.provision.fog.smithi183:Node is ready
2023-12-19T11:48:15.571 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2023-12-19T11:48:15.625 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2023-12-19T11:48:15.626 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2023-12-19T11:48:15.680 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2023-12-19T11:48:15.681 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-19T11:48:15.798 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2023-12-19T11:48:15.823 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2023-12-19T11:48:15.887 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2023-12-19T11:48:15.952 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-19T11:48:16.015 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-19T11:48:16.070 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T11:48:16.071 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T11:48:16.072 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2023-12-19T11:48:16.073 DEBUG:teuthology.parallel:result is None
2023-12-19T11:48:27.058 WARNING:teuthology.provision.fog.smithi203:timed out
2023-12-19T11:48:33.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:48:33.337 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T11:48:33.337 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T11:48:33.596 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-12-19T11:48:33.596 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-12-19T11:48:33.611 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203
2023-12-19T11:48:33.611 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203 /etc/hosts
2023-12-19T11:48:33.666 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-12-19T11:48:33.667 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-12-19T11:48:33.784 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203/smithi203/g' /etc/hosts
2023-12-19T11:48:33.809 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-12-19T11:48:33.874 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203/smithi203/g' /etc/hostname
2023-12-19T11:48:33.939 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-12-19T11:48:34.003 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-12-19T11:48:34.056 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.4"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T11:48:34.057 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T11:48:34.058 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T11:48:34.058 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T11:48:34.058 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-12-19T11:48:34.058 DEBUG:teuthology.parallel:result is None
2023-12-19T11:48:34.207 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2023-12-19T11:48:34.208 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T11:48:34.241 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-12-19T11:48:34.241 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T11:48:34.268 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2023-12-19T11:48:34.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-19T11:48:34.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:48:34.336 DEBUG:teuthology.orchestra.run.smithi183:> true
2023-12-19T11:48:34.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-19T11:48:34.452 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2023-12-19T11:48:34.507 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2023-12-19T11:48:34.507 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-19T11:48:34.563 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T11:48:34.563 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T11:48:34.563 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2023-12-19T11:48:34.563 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2023-12-19T11:48:34.563 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T11:48:34.564 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T11:48:34.565 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-19T11:48:34.591 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-12-19T11:48:34.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-12-19T11:48:34.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T11:48:34.657 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-12-19T11:48:34.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-12-19T11:48:34.720 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-12-19T11:48:34.778 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-12-19T11:48:34.778 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.4"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T11:48:34.831 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T11:48:34.832 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T11:48:34.832 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-12-19T11:48:34.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:48:34.968 INFO:teuthology.dispatcher.supervisor:Running job 7496241
2023-12-19T11:48:34.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7496241 --name rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7496241/orig.config.yaml
2023-12-19T11:48:34.972 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7496241
2023-12-19T11:48:34.972 INFO:teuthology.dispatcher.supervisor:Job PID: 3903632
2023-12-19T11:48:34.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T11:50:35.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:52:35.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:54:35.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:56:35.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T11:58:35.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T12:00:35.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T12:02:36.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T12:02:36.180 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T12:02:36.286 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T12:02:36.286 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T12:02:36.338 DEBUG:teuthology.nuke:shortname: smithi183
2023-12-19T12:02:36.338 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T12:02:36.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7496241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 11:43:20.775864', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHNCwgrRd7NXLh/B/Z4nL+XqKoUuiIpxbvgK0V1xo6/v+UI68NXyRr9siGBQVeG7t8BdbQkmEUIChZ8MU24O34='}
2023-12-19T12:02:36.366 DEBUG:teuthology.nuke:shortname: smithi203
2023-12-19T12:02:36.366 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T12:02:36.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:14:21-fs-rishabh-mdscap-pacific-testing-default-smithi/7496241', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 11:43:20.777832', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwjzaB1PqmzNgmYMF5W8xCAyhkT5eKv5SlFtgvwE9bS+z2qnWBW+GD6YMrNWFYZ+uoDgkgOyHSiih5PB13JdeE='}
2023-12-19T12:02:36.419 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-19T12:02:36.419 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T12:02:36.441 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-19T12:02:36.441 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T12:02:36.454 INFO:teuthology.orchestra.console.smithi203:Power off
2023-12-19T12:02:36.455 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T12:02:36.462 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-19T12:02:36.475 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-12-19T12:02:36.475 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T12:02:36.496 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-12-19T12:02:36.563 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-19T12:02:36.597 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-12-19T12:02:36.712 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2023-12-19T12:02:36.737 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com