2023-11-09T22:29:05.528 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T22:29:05.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:29:05.752 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4969d2bb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f496a82e670>, signals=[15])
2023-11-09T22:29:05.753 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging
2023-11-09T22:29:05.754 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T22:29:05.754 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2023-11-09T22:29:05.777 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2023-11-09T22:29:05.778 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T22:29:05.778 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-11-09T22:29:05.779 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /host {"name": "smithi122"}
2023-11-09T22:29:05.802 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /host {"name": "smithi176"}
2023-11-09T22:29:05.861 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T22:29:05.873 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T22:29:05.910 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T22:29:05.910 DEBUG:teuthology.provision.fog.smithi122:FOG request: PUT /host/227 {"imageID": 7}
2023-11-09T22:29:05.914 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T22:29:05.914 DEBUG:teuthology.provision.fog.smithi176:FOG request: PUT /host/281 {"imageID": 7}
2023-11-09T22:29:05.957 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of rhel 8.4
2023-11-09T22:29:05.957 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:29:05.967 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of rhel 8.4
2023-11-09T22:29:05.968 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:29:06.010 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T22:29:06.015 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T22:29:06.057 DEBUG:teuthology.provision.fog.smithi122:FOG request: POST /host/227/task {"taskTypeID": 1}
2023-11-09T22:29:06.068 DEBUG:teuthology.provision.fog.smithi176:FOG request: POST /host/281/task {"taskTypeID": 1}
2023-11-09T22:29:06.107 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:29:06.125 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:29:06.218 INFO:teuthology.orchestra.console.smithi122:Power off
2023-11-09T22:29:06.219 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:29:06.257 INFO:teuthology.orchestra.console.smithi176:Power off
2023-11-09T22:29:06.257 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:29:06.274 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2023-11-09T22:29:06.275 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:06.307 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2023-11-09T22:29:06.307 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:06.320 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-09T22:29:06.341 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-11-09T22:29:06.422 INFO:teuthology.orchestra.console.smithi122:Power off completed
2023-11-09T22:29:06.442 INFO:teuthology.orchestra.console.smithi176:Power off completed
2023-11-09T22:29:06.525 INFO:teuthology.orchestra.console.smithi122:Power on
2023-11-09T22:29:06.525 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T22:29:06.544 INFO:teuthology.orchestra.console.smithi176:Power on
2023-11-09T22:29:06.544 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T22:29:06.565 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On
2023-11-09T22:29:06.566 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:06.601 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On
2023-11-09T22:29:06.602 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:06.616 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-09T22:29:06.645 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-11-09T22:29:10.618 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:10.646 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:10.733 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-09T22:29:10.758 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-11-09T22:29:14.738 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:14.760 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:29:14.874 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2023-11-09T22:29:14.885 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2023-11-09T22:29:14.976 INFO:teuthology.orchestra.console.smithi176:Power on completed
2023-11-09T22:29:14.987 INFO:teuthology.orchestra.console.smithi122:Power on completed
2023-11-09T22:29:15.078 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2023-11-09T22:29:15.078 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:29:15.088 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2023-11-09T22:29:15.088 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:29:30.169 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:29:30.171 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:29:45.252 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:29:45.254 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:30:00.334 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:30:00.335 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:30:15.417 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:30:15.420 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:30:30.494 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:30:30.496 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:30:45.566 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:30:45.568 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:31:00.654 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:31:00.656 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:31:15.734 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:31:15.736 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:31:30.810 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:31:30.812 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:31:45.882 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:31:45.884 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:32:00.950 DEBUG:teuthology.provision.fog.smithi176:FOG request: GET /task/active None
2023-11-09T22:32:00.952 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-09T22:32:01.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:01.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:19.326 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-11-09T22:32:19.578 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-09T22:32:25.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:25.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:28.414 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-11-09T22:32:28.634 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-09T22:32:34.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:34.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:37.502 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-11-09T22:32:37.690 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-09T22:32:43.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:43.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:46.586 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-11-09T22:32:46.746 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-09T22:32:52.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:52.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:32:55.802 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-09T22:33:01.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:33:52.643 WARNING:teuthology.provision.fog.smithi176:timed out
2023-11-09T22:33:58.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:33:58.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T22:33:58.931 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T22:33:59.215 INFO:teuthology.provision.fog.smithi176:Node is ready
2023-11-09T22:33:59.216 DEBUG:teuthology.orchestra.run.smithi176:> hostname
2023-11-09T22:33:59.232 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176
2023-11-09T22:33:59.232 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176 /etc/hosts
2023-11-09T22:33:59.288 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2023-11-09T22:33:59.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2023-11-09T22:33:59.393 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176/smithi176/g' /etc/hosts
2023-11-09T22:33:59.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts
2023-11-09T22:33:59.486 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176/smithi176/g' /etc/hostname
2023-11-09T22:33:59.552 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2023-11-09T22:33:59.615 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2023-11-09T22:33:59.669 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:33:59.669 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:33:59.670 INFO:teuthology.orchestra.run.smithi176.stdout:ID="rhel"
2023-11-09T22:33:59.670 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="fedora"
2023-11-09T22:33:59.670 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8.4"
2023-11-09T22:33:59.670 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:33:59.670 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:33:59.671 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-11-09T22:33:59.671 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:33:59.671 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:33:59.671 INFO:teuthology.orchestra.run.smithi176.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:33:59.671 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:33:59.672 INFO:teuthology.orchestra.run.smithi176.stdout:
2023-11-09T22:33:59.672 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:33:59.672 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:33:59.672 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:33:59.672 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:33:59.673 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2023-11-09T22:33:59.674 DEBUG:teuthology.parallel:result is None
2023-11-09T22:34:01.810 WARNING:teuthology.provision.fog.smithi122:timed out
2023-11-09T22:34:07.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:34:08.140 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T22:34:08.140 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T22:34:08.510 INFO:teuthology.provision.fog.smithi122:Node is ready
2023-11-09T22:34:08.511 DEBUG:teuthology.orchestra.run.smithi122:> hostname
2023-11-09T22:34:08.527 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com
2023-11-09T22:34:08.528 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts
2023-11-09T22:34:08.583 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122
2023-11-09T22:34:08.584 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2023-11-09T22:34:08.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts
2023-11-09T22:34:08.713 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts
2023-11-09T22:34:08.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname
2023-11-09T22:34:08.844 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2023-11-09T22:34:08.908 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2023-11-09T22:34:08.962 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:34:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:34:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2023-11-09T22:34:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2023-11-09T22:34:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.4"
2023-11-09T22:34:08.963 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:34:08.964 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:34:08.965 INFO:teuthology.orchestra.run.smithi122.stdout:
2023-11-09T22:34:08.965 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:34:08.965 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:34:08.965 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:34:08.965 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:34:08.966 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2023-11-09T22:34:08.970 DEBUG:teuthology.parallel:result is None
2023-11-09T22:34:09.114 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2023-11-09T22:34:09.115 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T22:34:09.132 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2023-11-09T22:34:09.132 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T22:34:09.149 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2023-11-09T22:34:09.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2023-11-09T22:34:09.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:34:09.215 DEBUG:teuthology.orchestra.run.smithi122:> true
2023-11-09T22:34:09.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com'
2023-11-09T22:34:09.280 DEBUG:teuthology.orchestra.run.smithi122:> uname -m
2023-11-09T22:34:09.334 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2023-11-09T22:34:09.334 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2023-11-09T22:34:09.388 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:34:09.388 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:34:09.388 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2023-11-09T22:34:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2023-11-09T22:34:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.4"
2023-11-09T22:34:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:34:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:34:09.389 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2023-11-09T22:34:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:34:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:34:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:34:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:34:09.390 INFO:teuthology.orchestra.run.smithi122.stdout:
2023-11-09T22:34:09.391 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:34:09.391 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:34:09.391 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:34:09.392 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:34:09.393 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2023-11-09T22:34:09.415 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2023-11-09T22:34:09.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-11-09T22:34:09.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:34:09.485 DEBUG:teuthology.orchestra.run.smithi176:> true
2023-11-09T22:34:09.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-11-09T22:34:09.551 DEBUG:teuthology.orchestra.run.smithi176:> uname -m
2023-11-09T22:34:09.607 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2023-11-09T22:34:09.607 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2023-11-09T22:34:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:34:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:34:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:ID="rhel"
2023-11-09T22:34:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="fedora"
2023-11-09T22:34:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8.4"
2023-11-09T22:34:09.664 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:34:09.664 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:34:09.664 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-11-09T22:34:09.664 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:34:09.664 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:34:09.665 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:34:09.666 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:34:09.666 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-11-09T22:34:09.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:34:09.792 INFO:teuthology.dispatcher.supervisor:Running job 7453219
2023-11-09T22:34:09.793 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453219 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453219/orig.config.yaml
2023-11-09T22:34:09.798 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453219
2023-11-09T22:34:09.799 INFO:teuthology.dispatcher.supervisor:Job PID: 4032405
2023-11-09T22:34:09.800 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T22:36:09.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:38:10.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:40:10.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:42:10.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:44:10.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:46:10.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:48:10.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:50:11.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:52:11.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:52:11.334 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T22:52:11.465 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T22:52:11.465 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T22:52:11.559 DEBUG:teuthology.nuke:shortname: smithi122
2023-11-09T22:52:11.560 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:52:11.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 22:29:04.593941', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKEuPuhUXYMaVIdhVpU3bqOVv5fO8J0+9kiuN8ZR1S5kkiG6o39EUfcFtImPKLVfEmS2+c6x3XEtXzxeBmdrPME='}
2023-11-09T22:52:11.615 DEBUG:teuthology.nuke:shortname: smithi176
2023-11-09T22:52:11.615 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:52:11.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453219', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 22:29:04.595268', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBe2xMvwh+y5+pMKi5u6nYvpVoWyO2eoEdPR1TmrWYgONanbzXL7E+6GwjyB0WmdU3Kc1RGdRqf9HvZN4zYyX/M='}
2023-11-09T22:52:11.738 INFO:teuthology.orchestra.console.smithi122:Power off
2023-11-09T22:52:11.739 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:52:11.777 INFO:teuthology.orchestra.console.smithi176:Power off
2023-11-09T22:52:11.778 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:52:11.790 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2023-11-09T22:52:11.790 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:52:11.841 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-09T22:52:11.849 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2023-11-09T22:52:11.849 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:52:11.928 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-11-09T22:52:11.942 INFO:teuthology.orchestra.console.smithi122:Power off completed
2023-11-09T22:52:12.030 INFO:teuthology.orchestra.console.smithi176:Power off completed
2023-11-09T22:52:12.126 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com
2023-11-09T22:52:12.200 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com