2023-06-26T23:56:33.469 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-26T23:56:33.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-26T23:56:33.471 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-26T23:56:48.251 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f82b8b89640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f82b9da78b0>, signals=[15])
2023-06-26T23:56:48.252 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-06-26T23:56:48.253 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-06-26T23:56:48.253 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-06-26T23:56:48.272 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-06-26T23:56:48.272 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-06-26T23:56:48.273 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-06-26T23:56:48.274 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"}
2023-06-26T23:56:53.304 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-06-26T23:56:58.441 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-26T23:57:08.189 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-26T23:57:13.194 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-26T23:57:13.194 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 7}
2023-06-26T23:57:16.705 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.4
2023-06-26T23:57:16.705 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:57:16.708 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-26T23:57:16.709 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 7}
2023-06-26T23:57:16.749 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.4
2023-06-26T23:57:16.749 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-26T23:57:16.774 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"}
2023-06-26T23:57:16.808 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1}
2023-06-26T23:57:16.811 DEBUG:teuthology.provision.fog.smithi119:Canceling deploy task with ID 346366
2023-06-26T23:57:16.811 DEBUG:teuthology.provision.fog.smithi119:FOG request: DELETE /task/cancel {"id": 346366}
2023-06-26T23:57:16.855 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-06-26T23:57:16.891 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-06-26T23:57:16.944 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:57:16.955 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-26T23:57:27.070 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-26T23:57:27.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-26T23:57:27.082 INFO:teuthology.orchestra.console:Power off smithi119
2023-06-26T23:57:27.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-26T23:57:32.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:32.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:32.227 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2023-06-26T23:57:32.328 INFO:teuthology.orchestra.console:Power on smithi119
2023-06-26T23:57:32.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-26T23:57:32.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:36.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:37.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:37.313 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-26T23:57:37.414 INFO:teuthology.orchestra.console:Power on smithi031
2023-06-26T23:57:37.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-26T23:57:37.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:41.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:41.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:46.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:46.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:51.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:51.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:56.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:57:56.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:01.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:01.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:07.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:07.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:12.131 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:12.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:17.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:17.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:17.461 INFO:teuthology.orchestra.console:Power on for smithi119 completed
2023-06-26T23:58:17.562 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-06-26T23:58:17.563 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-26T23:58:22.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-26T23:58:25.680 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-26T23:58:26.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-26T23:58:27.453 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-06-26T23:58:27.554 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-06-26T23:58:27.554 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:58:31.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-26T23:58:39.984 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-26T23:58:45.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-26T23:58:52.012 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:59:04.304 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-26T23:59:10.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-26T23:59:11.690 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-26T23:59:12.101 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:59:17.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-26T23:59:17.810 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:18.887 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:24.963 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:26.077 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:27.150 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:33.153 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-26T23:59:38.230 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:39.344 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:45.460 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:51.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-26T23:59:57.585 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-27T00:00:02.660 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed.
2023-06-27T00:00:02.660 WARNING:teuthology.provision.fog.smithi119:'connect to smithi119.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds
2023-06-27T00:00:08.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:00:17.673 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-27T00:00:22.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:00:30.832 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-27T00:00:36.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:00:39.888 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-27T00:00:45.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:00:48.948 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-27T00:00:54.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:00:58.000 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-27T00:01:04.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:01:13.665 WARNING:teuthology.provision.fog.smithi119:timed out
2023-06-27T00:01:19.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:01:27.408 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-27T00:01:33.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:01:41.771 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-27T00:01:41.773 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-27T00:01:43.024 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-27T00:01:49.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:01:54.292 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-27T00:01:54.293 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-27T00:02:02.033 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-06-27T00:02:02.034 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2023-06-27T00:02:02.050 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2023-06-27T00:02:02.050 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2023-06-27T00:02:02.104 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2023-06-27T00:02:02.105 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-27T00:02:02.245 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2023-06-27T00:02:02.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2023-06-27T00:02:02.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2023-06-27T00:02:02.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-27T00:02:02.461 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-06-27T00:02:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T00:02:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.4 (Ootpa)"
2023-06-27T00:02:02.515 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.4"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-27T00:02:02.516 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T00:02:02.517 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-27T00:02:02.518 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2023-06-27T00:02:02.520 DEBUG:teuthology.parallel:result is None
2023-06-27T00:02:14.549 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-06-27T00:02:14.549 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-06-27T00:02:14.567 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2023-06-27T00:02:14.567 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2023-06-27T00:02:14.623 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-06-27T00:02:14.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-06-27T00:02:14.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2023-06-27T00:02:14.815 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-06-27T00:02:14.878 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2023-06-27T00:02:14.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-06-27T00:02:15.006 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-06-27T00:02:15.060 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-06-27T00:02:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-06-27T00:02:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T00:02:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-27T00:02:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T00:02:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-27T00:02:15.063 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-06-27T00:02:15.064 DEBUG:teuthology.parallel:result is None
2023-06-27T00:02:20.257 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2023-06-27T00:02:20.258 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-27T00:02:20.911 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-06-27T00:02:20.911 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-27T00:02:20.928 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2023-06-27T00:02:20.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-06-27T00:02:20.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:02:21.001 DEBUG:teuthology.orchestra.run.smithi031:> true
2023-06-27T00:02:21.080 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2023-06-27T00:02:21.135 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2023-06-27T00:02:21.136 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-06-27T00:02:21.190 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T00:02:21.190 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.4 (Ootpa)"
2023-06-27T00:02:21.190 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-06-27T00:02:21.190 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-06-27T00:02:21.190 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.4"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T00:02:21.191 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T00:02:21.192 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-06-27T00:02:21.192 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T00:02:21.192 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-27T00:02:21.192 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T00:02:21.192 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-27T00:02:21.193 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-06-27T00:02:21.219 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-06-27T00:02:21.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-06-27T00:02:21.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-27T00:02:21.288 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-06-27T00:02:21.357 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-06-27T00:02:21.414 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-06-27T00:02:21.414 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-06-27T00:02:21.470 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-06-27T00:02:21.470 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-06-27T00:02:21.470 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-06-27T00:02:21.470 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-06-27T00:02:21.471 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-27T00:02:21.472 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-27T00:02:21.472 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-06-27T00:02:21.472 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-27T00:02:21.473 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-27T00:02:21.473 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-27T00:02:21.473 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-27T00:02:21.473 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-06-27T00:02:26.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:02:26.502 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:02:31.597 INFO:teuthology.dispatcher.supervisor:Running job 7317162
2023-06-27T00:02:31.598 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317162 --name yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317162/orig.config.yaml
2023-06-27T00:02:31.601 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317162
2023-06-27T00:02:31.602 INFO:teuthology.dispatcher.supervisor:Job PID: 20391
2023-06-27T00:02:31.602 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-27T00:04:31.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:04:31.605 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:06:32.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:06:32.080 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:08:37.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:08:37.165 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:10:38.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:10:38.131 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:12:42.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:12:42.216 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:14:47.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:14:47.304 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:16:48.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:16:48.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:18:52.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:18:52.895 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:20:55.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:20:55.825 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:23:00.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-27T00:23:00.920 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-27T00:23:02.525 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-27T00:23:02.636 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-27T00:23:02.637 INFO:teuthology.nuke:Checking targets against current locks
2023-06-27T00:23:02.686 DEBUG:teuthology.nuke:shortname: smithi031
2023-06-27T00:23:02.687 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-27T00:23:02.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317162', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 23:56:32.670482', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDqFagUrtMErc516sdMbuVrxatu+fLOEkdvXwyBd0DuaenP+pxEvLp5MHvDIuwQVsW2tvg+oKdfVKtDGDx2OSfHoV3waKwFTAK5sMkjQQtWxRnvBVP2uIZuug7TElNauQxUywhMEeHyq3KK50L2M3s1X7NCsIUGM9qW4hKe/jGgV9rOMHOYd5RTfi9B8lvRwHLwKGTXjO0Y4dCJp4XCfoyiQ8NPUT4GfVCFRTEz2FJs8y/azn7/WqZw/6NzAX+jU3sTHEPXFifyL4GyVvCJM4SSDH/PFUVEUROxREcNi5a8y5NxRMjKgcKFaJkHsCcjaDPw571rkVGYz6H50D1kPQjU5dnfkHaIb5vFCXr278GKpcwOPSE2aHKhckZCo79GF68bDoXMwxrKUwtFj8Jp3asmhwPUKLneHJVzMzaGz6QqPbYzA03kGLWCv4I0mQpPkAkS70TyvxtDSZEb+nEXdF3c57uiI7zqA7ed3mtiDk3dee5YoCo3QTZ8IbB3QUp0J0='}
2023-06-27T00:23:02.715 DEBUG:teuthology.nuke:shortname: smithi119
2023-06-27T00:23:02.716 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-27T00:23:02.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317162', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 23:56:32.669071', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFpwmdJT1kmI3dRuhXTx6BALIY3hOoD+1gtKCC5nRG65f+97FcaUN7AtLR5x10qUsgu6781oHjJ/q5lcKmVWt6vxH5s395uuDKHtlgcA1obxtim1H03TiEdcgM8XVnmZPhCWqiVdlVjKlxatiZLT7yU81pj6MHMe00wqDJVCPbNIbF/eEkvKZ/LWlps8wVw3atfrJkg4L+aEEht2nBaOZf9CJkHGu9x+nzpp6uFiMxq2NbfZlnoqMKgeq7l9uCvzoaqXneI9lkFkJxGV22iTVPcH+7OA9IoEy0OwheEsyc5rcioWAL2R5VWf+WrUR5HBCDNKHF/KiLfmbqEpP0E7YlAUFVbrOwKqhc6Vg+BrN5343asXAfeBiuDLcDgalDOmFHh+WPcCdMeVxlEJcFho3iHXJsO9Uak3cU4Lwg/HHYSnHChSwWKj8FrVcioUim0yy6jboL0GdUlXJK1Xtyva27W20tz/UvLawMJ3cQszfsAeOx2hNvhMXOyQOWCqebfU='}
2023-06-27T00:23:02.774 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-27T00:23:02.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T00:23:02.796 INFO:teuthology.orchestra.console:Power off smithi119
2023-06-27T00:23:02.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-27T00:23:02.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T00:23:07.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T00:23:12.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T00:23:13.150 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-27T00:23:18.257 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-27T00:23:23.288 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2023-06-27T00:23:23.318 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-06-27T00:23:33.458 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com