2023-11-09T22:54:35.005 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T22:54:35.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:54:35.182 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f888d90fa30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f888e3fb670>, signals=[15])
2023-11-09T22:54:35.184 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-11-09T22:54:35.184 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T22:54:35.184 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-09T22:54:35.220 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2023-11-09T22:54:35.220 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T22:54:35.220 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-09T22:54:35.222 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-11-09T22:54:35.261 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"}
2023-11-09T22:54:35.327 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T22:54:35.358 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T22:54:35.381 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T22:54:35.382 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 7}
2023-11-09T22:54:35.417 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T22:54:35.417 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 7}
2023-11-09T22:54:35.455 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.4
2023-11-09T22:54:35.455 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:54:35.470 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.4
2023-11-09T22:54:35.470 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:54:35.522 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T22:54:35.536 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T22:54:35.579 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1}
2023-11-09T22:54:35.590 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-11-09T22:54:35.682 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:54:35.701 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:54:35.837 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-09T22:54:35.838 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:54:35.864 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-09T22:54:35.865 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:54:35.895 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-09T22:54:35.896 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:35.915 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-09T22:54:35.915 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:35.947 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T22:54:35.967 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T22:54:39.952 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:39.968 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:40.062 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T22:54:40.083 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T22:54:44.070 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:44.084 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:44.179 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T22:54:44.197 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T22:54:44.280 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-09T22:54:44.381 INFO:teuthology.orchestra.console.smithi104:Power on
2023-11-09T22:54:44.381 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T22:54:44.444 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2023-11-09T22:54:44.445 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:44.494 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T22:54:48.202 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:48.319 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T22:54:48.420 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-09T22:54:48.495 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:48.521 INFO:teuthology.orchestra.console.smithi081:Power on
2023-11-09T22:54:48.522 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T22:54:48.570 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-11-09T22:54:48.571 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:48.608 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T22:54:48.610 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T22:54:52.611 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:52.619 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:52.722 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T22:54:52.818 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T22:54:52.919 INFO:teuthology.orchestra.console.smithi104:Power on completed
2023-11-09T22:54:53.020 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2023-11-09T22:54:53.020 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:54:56.726 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:54:56.836 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T22:54:56.937 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-11-09T22:54:57.038 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-11-09T22:54:57.038 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:55:08.114 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:55:12.117 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:55:23.190 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:55:27.186 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:55:38.262 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:55:42.266 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:55:53.347 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:55:57.338 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:56:08.434 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:56:12.414 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:56:23.498 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:56:27.478 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:56:38.570 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:56:42.544 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:56:53.642 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:56:57.606 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:57:08.713 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:57:12.670 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:57:23.786 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:57:27.731 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:57:38.856 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T22:57:38.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:57:42.794 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T22:57:42.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:57:57.370 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-09T22:58:01.210 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T22:58:03.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:06.458 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-09T22:58:07.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:10.298 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T22:58:12.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:15.546 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-09T22:58:16.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:19.387 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T22:58:21.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:24.634 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-09T22:58:25.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:28.474 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T22:58:30.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:34.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:58:37.566 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T22:58:43.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:59:30.710 WARNING:teuthology.provision.fog.smithi104:timed out
2023-11-09T22:59:36.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:59:37.116 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T22:59:37.117 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T22:59:37.369 INFO:teuthology.provision.fog.smithi104:Node is ready
2023-11-09T22:59:37.370 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2023-11-09T22:59:37.384 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2023-11-09T22:59:37.385 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2023-11-09T22:59:37.440 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2023-11-09T22:59:37.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-09T22:59:37.549 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2023-11-09T22:59:37.574 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2023-11-09T22:59:37.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2023-11-09T22:59:37.701 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-09T22:59:37.765 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-09T22:59:37.819 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:59:37.819 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:59:37.819 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2023-11-09T22:59:37.820 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2023-11-09T22:59:37.820 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.4"
2023-11-09T22:59:37.820 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:59:37.820 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:59:37.820 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-09T22:59:37.821 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:59:37.821 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:59:37.821 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:59:37.821 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:59:37.821 INFO:teuthology.orchestra.run.smithi104.stdout:
2023-11-09T22:59:37.822 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:59:37.822 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:59:37.822 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:59:37.822 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:59:37.823 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2023-11-09T22:59:37.824 DEBUG:teuthology.parallel:result is None
2023-11-09T22:59:43.587 WARNING:teuthology.provision.fog.smithi081:timed out
2023-11-09T22:59:49.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:59:49.992 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T22:59:49.993 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T22:59:50.201 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-11-09T22:59:50.202 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-11-09T22:59:50.256 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081
2023-11-09T22:59:50.256 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081 /etc/hosts
2023-11-09T22:59:50.311 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-11-09T22:59:50.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-09T22:59:50.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hosts
2023-11-09T22:59:50.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-11-09T22:59:50.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hostname
2023-11-09T22:59:50.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-09T22:59:50.640 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-09T22:59:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:59:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:59:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-09T22:59:50.695 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-09T22:59:50.695 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-11-09T22:59:50.695 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:59:50.695 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:59:50.695 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-09T22:59:50.696 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:59:50.696 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:59:50.696 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:59:50.696 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:59:50.697 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-09T22:59:50.697 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:59:50.698 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:59:50.698 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:59:50.698 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:59:50.699 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-11-09T22:59:50.699 DEBUG:teuthology.parallel:result is None
2023-11-09T22:59:51.005 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-11-09T22:59:51.006 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T22:59:51.040 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2023-11-09T22:59:51.041 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T22:59:51.074 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-11-09T22:59:51.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-09T22:59:51.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:59:51.168 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-11-09T22:59:51.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-09T22:59:51.229 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-11-09T22:59:51.282 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-11-09T22:59:51.283 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-09T22:59:51.336 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:59:51.336 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:59:51.337 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-09T22:59:51.337 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-09T22:59:51.337 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-11-09T22:59:51.337 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:59:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:59:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-09T22:59:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:59:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:59:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:59:51.339 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:59:51.339 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-09T22:59:51.339 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:59:51.339 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:59:51.340 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:59:51.340 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:59:51.341 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-09T22:59:51.373 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2023-11-09T22:59:51.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-09T22:59:51.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T22:59:51.451 DEBUG:teuthology.orchestra.run.smithi104:> true
2023-11-09T22:59:51.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-09T22:59:51.565 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2023-11-09T22:59:51.620 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2023-11-09T22:59:51.620 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-09T22:59:51.674 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T22:59:51.675 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T22:59:51.675 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2023-11-09T22:59:51.675 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2023-11-09T22:59:51.675 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.4"
2023-11-09T22:59:51.675 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2023-11-09T22:59:51.676 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T22:59:51.676 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-09T22:59:51.676 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T22:59:51.676 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T22:59:51.677 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T22:59:51.677 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T22:59:51.677 INFO:teuthology.orchestra.run.smithi104.stdout:
2023-11-09T22:59:51.677 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T22:59:51.677 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T22:59:51.678 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T22:59:51.678 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T22:59:51.678 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-09T22:59:51.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:59:51.832 INFO:teuthology.dispatcher.supervisor:Running job 7453253
2023-11-09T22:59:51.832 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453253 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453253/orig.config.yaml
2023-11-09T22:59:51.836 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453253
2023-11-09T22:59:51.836 INFO:teuthology.dispatcher.supervisor:Job PID: 215651
2023-11-09T22:59:51.837 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T23:01:51.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:03:52.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:05:52.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:07:52.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:09:52.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:11:52.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:13:52.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:15:53.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:15:53.195 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T23:15:53.296 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T23:15:53.296 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T23:15:53.346 DEBUG:teuthology.nuke:shortname: smithi081
2023-11-09T23:15:53.346 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T23:15:53.370 DEBUG:teuthology.nuke:shortname: smithi104
2023-11-09T23:15:53.370 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T23:15:53.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 22:54:34.101206', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVp/E/WTdUOAf0DGNmzucqiI2Sb4oSqcwCWKpJd9OAxvmS1+SiBrjk6TgedbSei/mVpCGejXwPHitbqY/CBndg='}
2023-11-09T23:15:53.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 22:54:34.103180', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8u7B6vcRi08pxUrBhLp15Ka7y0fUoAT+K9nankvA64wfvkBjy73OQdkPibCCL/ufAZ8ICizmrOJ5Ip8uK9Y7c='}
2023-11-09T23:15:53.426 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-09T23:15:53.426 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T23:15:53.444 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-09T23:15:53.445 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T23:15:53.453 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-09T23:15:53.453 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:15:53.466 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-09T23:15:53.467 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:15:53.478 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T23:15:53.491 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T23:15:53.579 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-09T23:15:53.593 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-09T23:15:53.733 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-11-09T23:15:53.742 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com