2023-07-04T04:10:15.789 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-04T04:10:15.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:10:15.791 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:10:15.958 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fefba1565b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fefba18cd30>, signals=[15])
2023-07-04T04:10:15.959 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2023-07-04T04:10:15.960 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2023-07-04T04:10:15.960 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-07-04T04:10:15.994 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2023-07-04T04:10:15.994 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2023-07-04T04:10:15.995 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-07-04T04:10:15.996 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"}
2023-07-04T04:10:16.019 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"}
2023-07-04T04:10:16.072 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-04T04:10:16.088 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-04T04:10:16.112 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-04T04:10:16.113 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 5}
2023-07-04T04:10:16.129 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-04T04:10:16.129 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 5}
2023-07-04T04:10:16.162 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6
2023-07-04T04:10:16.162 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:10:16.172 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6
2023-07-04T04:10:16.173 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:10:16.223 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"}
2023-07-04T04:10:16.227 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"}
2023-07-04T04:10:16.271 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1}
2023-07-04T04:10:16.277 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1}
2023-07-04T04:10:16.327 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:10:16.335 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:10:16.432 INFO:teuthology.orchestra.console:Power off smithi177
2023-07-04T04:10:16.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-04T04:10:16.453 INFO:teuthology.orchestra.console:Power off smithi045
2023-07-04T04:10:16.454 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-04T04:10:16.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:16.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:20.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:20.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:24.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:24.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:24.827 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-07-04T04:10:24.928 INFO:teuthology.orchestra.console:Power on smithi045
2023-07-04T04:10:24.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-04T04:10:24.951 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:28.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:28.934 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-07-04T04:10:28.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:29.036 INFO:teuthology.orchestra.console:Power on smithi177
2023-07-04T04:10:29.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-04T04:10:29.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:29.188 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2023-07-04T04:10:29.289 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2023-07-04T04:10:29.290 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:10:33.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:10:33.299 INFO:teuthology.orchestra.console:Power on for smithi177 completed
2023-07-04T04:10:33.400 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2023-07-04T04:10:33.401 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:10:44.368 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:10:48.492 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:10:59.446 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:11:03.556 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:11:14.524 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:11:18.620 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:11:29.607 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:11:33.688 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:11:44.684 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:11:48.756 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:11:59.765 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:12:03.826 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:12:14.860 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:12:18.908 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:12:29.944 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:12:34.000 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:12:45.020 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:12:49.084 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:13:00.096 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-04T04:13:00.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:03.252 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:04.176 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:13:09.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:12.336 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:18.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:19.255 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-04T04:13:19.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:21.396 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:22.416 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:13:27.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:30.480 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:31.476 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:13:36.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:37.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:39.536 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:40.532 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:13:45.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:46.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:48.592 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-04T04:13:49.584 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:13:54.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:55.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:13:58.640 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:14:04.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:14:07.696 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-04T04:14:13.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:14:54.636 WARNING:teuthology.provision.fog.smithi045:timed out
2023-07-04T04:15:00.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:15:00.982 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-04T04:15:00.983 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-04T04:15:01.255 INFO:teuthology.provision.fog.smithi045:Node is ready
2023-07-04T04:15:01.255 DEBUG:teuthology.orchestra.run.smithi045:> hostname
2023-07-04T04:15:01.273 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2023-07-04T04:15:01.273 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts
2023-07-04T04:15:01.331 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2023-07-04T04:15:01.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-07-04T04:15:01.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts
2023-07-04T04:15:01.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts
2023-07-04T04:15:01.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname
2023-07-04T04:15:01.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-07-04T04:15:01.700 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-07-04T04:15:01.757 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-07-04T04:15:01.757 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-07-04T04:15:01.758 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-04T04:15:01.759 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-04T04:15:01.760 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-04T04:15:01.760 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2023-07-04T04:15:01.765 DEBUG:teuthology.parallel:result is None
2023-07-04T04:15:13.712 WARNING:teuthology.provision.fog.smithi177:timed out
2023-07-04T04:15:19.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:15:20.050 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-04T04:15:20.050 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-04T04:15:20.321 INFO:teuthology.provision.fog.smithi177:Node is ready
2023-07-04T04:15:20.322 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2023-07-04T04:15:20.339 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2023-07-04T04:15:20.339 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2023-07-04T04:15:20.397 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2023-07-04T04:15:20.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-07-04T04:15:20.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2023-07-04T04:15:20.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2023-07-04T04:15:20.619 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2023-07-04T04:15:20.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-07-04T04:15:20.750 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-07-04T04:15:20.807 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-07-04T04:15:20.807 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2023-07-04T04:15:20.807 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-07-04T04:15:20.807 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-07-04T04:15:20.808 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-04T04:15:20.809 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-04T04:15:20.809 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2023-07-04T04:15:20.810 DEBUG:teuthology.parallel:result is None
2023-07-04T04:15:20.963 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2023-07-04T04:15:20.964 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2023-07-04T04:15:20.964 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-04T04:15:20.999 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2023-07-04T04:15:21.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-07-04T04:15:21.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:15:21.067 DEBUG:teuthology.orchestra.run.smithi045:> true
2023-07-04T04:15:21.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-07-04T04:15:21.206 DEBUG:teuthology.orchestra.run.smithi045:> uname -m
2023-07-04T04:15:21.263 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2023-07-04T04:15:21.264 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-07-04T04:15:21.321 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-07-04T04:15:21.321 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)"
2023-07-04T04:15:21.321 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-04T04:15:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-04T04:15:21.323 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-04T04:15:21.324 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-07-04T04:15:21.347 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2023-07-04T04:15:21.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-07-04T04:15:21.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-04T04:15:21.412 DEBUG:teuthology.orchestra.run.smithi177:> true
2023-07-04T04:15:21.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-07-04T04:15:21.478 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2023-07-04T04:15:21.534 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2023-07-04T04:15:21.534 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-07-04T04:15:21.589 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-07-04T04:15:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-04T04:15:21.591 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-07-04T04:15:21.592 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-04T04:15:21.592 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-04T04:15:21.592 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-04T04:15:21.592 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-04T04:15:21.592 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-07-04T04:15:21.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:15:21.615 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:15:21.703 INFO:teuthology.dispatcher.supervisor:Running job 7325934
2023-07-04T04:15:21.704 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325934 --name prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325934/orig.config.yaml
2023-07-04T04:15:21.707 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325934
2023-07-04T04:15:21.708 INFO:teuthology.dispatcher.supervisor:Job PID: 21886
2023-07-04T04:15:21.709 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-04T04:17:21.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:17:21.810 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:19:21.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:19:21.999 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:21:22.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:21:22.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:23:22.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:23:22.360 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:25:22.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:25:22.543 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:27:22.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:27:22.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:29:22.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:29:22.889 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:31:23.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:31:23.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:33:23.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:33:23.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:35:23.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:35:23.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:37:23.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:37:23.748 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:39:23.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:39:23.922 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:41:24.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:41:24.099 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:43:24.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:43:24.252 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:45:24.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:45:24.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:47:24.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:47:24.601 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:49:24.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-04T04:49:24.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-04T04:49:24.857 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-04T04:49:24.968 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-04T04:49:24.969 INFO:teuthology.nuke:Checking targets against current locks
2023-07-04T04:49:25.027 DEBUG:teuthology.nuke:shortname: smithi045
2023-07-04T04:49:25.028 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-04T04:49:25.054 DEBUG:teuthology.nuke:shortname: smithi177
2023-07-04T04:49:25.054 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-04T04:49:25.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:10:14.915086', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-04T04:49:25.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:10:14.913807', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-04T04:49:25.116 INFO:teuthology.orchestra.console:Power off smithi045
2023-07-04T04:49:25.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-04T04:49:25.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:49:25.167 INFO:teuthology.orchestra.console:Power off smithi177
2023-07-04T04:49:25.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-04T04:49:25.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-04T04:49:25.282 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-07-04T04:49:25.324 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-07-04T04:49:25.464 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2023-07-04T04:49:25.480 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com