2023-08-01T14:50:02.472 INFO:root:teuthology version: 0.0.1.dev174+g10753fd
2023-08-01T14:50:02.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T14:50:02.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4d68422820>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4d67cfaf70>, signals=[15])
2023-08-01T14:50:02.715 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging
2023-08-01T14:50:02.716 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server
2023-08-01T14:50:02.716 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2023-08-01T14:50:02.733 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-08-01T14:50:02.733 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-08-01T14:50:02.733 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-08-01T14:50:02.735 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /host {"name": "smithi018"}
2023-08-01T14:50:02.749 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-08-01T14:50:02.808 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-01T14:50:02.814 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-01T14:50:02.845 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-01T14:50:02.846 DEBUG:teuthology.provision.fog.smithi018:FOG request: PUT /host/124 {"imageID": 7}
2023-08-01T14:50:02.852 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-01T14:50:02.852 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 7}
2023-08-01T14:50:02.883 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of rhel 8.4
2023-08-01T14:50:02.884 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:50:02.906 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.4
2023-08-01T14:50:02.907 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:50:02.954 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /tasktype {"name": "deploy"}
2023-08-01T14:50:02.975 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-08-01T14:50:02.987 DEBUG:teuthology.provision.fog.smithi018:FOG request: POST /host/124/task {"taskTypeID": 1}
2023-08-01T14:50:03.008 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-08-01T14:50:03.032 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:50:03.051 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:50:03.155 INFO:teuthology.orchestra.console.smithi018:Power off
2023-08-01T14:50:03.156 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T14:50:03.174 INFO:teuthology.orchestra.console.smithi119:Power off
2023-08-01T14:50:03.175 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T14:50:03.185 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2023-08-01T14:50:03.185 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:03.196 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-08-01T14:50:03.197 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:03.208 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-08-01T14:50:03.219 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-08-01T14:50:07.212 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:07.220 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:07.322 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-08-01T14:50:07.331 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-08-01T14:50:11.327 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:11.335 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:11.437 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-08-01T14:50:11.444 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-08-01T14:50:11.539 INFO:teuthology.orchestra.console.smithi018:Power off completed
2023-08-01T14:50:11.639 INFO:teuthology.orchestra.console.smithi018:Power on
2023-08-01T14:50:11.640 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-01T14:50:11.660 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On
2023-08-01T14:50:11.660 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:11.682 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-08-01T14:50:15.448 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:15.557 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-08-01T14:50:15.658 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-08-01T14:50:15.683 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:15.759 INFO:teuthology.orchestra.console.smithi119:Power on
2023-08-01T14:50:15.759 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-01T14:50:15.778 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2023-08-01T14:50:15.779 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:15.791 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-08-01T14:50:15.799 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-08-01T14:50:19.797 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:19.806 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T14:50:19.908 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2023-08-01T14:50:19.915 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-08-01T14:50:20.009 INFO:teuthology.orchestra.console.smithi018:Power on completed
2023-08-01T14:50:20.016 INFO:teuthology.orchestra.console.smithi119:Power on completed
2023-08-01T14:50:20.111 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2023-08-01T14:50:20.111 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:50:20.117 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-08-01T14:50:20.118 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:50:35.224 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:50:35.225 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:50:50.340 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:50:50.341 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:51:05.464 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:51:05.465 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:51:20.576 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:51:20.577 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:51:35.712 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:51:35.713 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:51:50.824 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:51:50.826 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:52:05.964 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:52:05.965 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:52:21.112 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:52:21.113 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:52:36.256 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:52:36.257 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:52:51.392 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:52:51.393 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:53:06.512 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:53:06.513 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:53:21.614 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:53:21.616 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:53:36.737 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:53:36.738 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:53:51.868 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:53:51.869 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:54:06.980 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:54:06.981 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:54:22.084 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:54:22.085 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:54:37.172 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:54:37.173 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-08-01T14:54:37.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:54:52.264 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:54:55.600 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:55:01.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:55:04.656 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:55:07.340 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:55:10.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:55:13.716 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:55:19.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:55:22.400 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:55:22.800 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:55:28.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:55:31.856 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:55:37.468 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:55:37.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:55:52.536 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:55:56.272 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:56:02.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:05.328 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:56:07.594 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None
2023-08-01T14:56:07.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:11.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:14.384 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-08-01T14:56:20.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:20.851 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-01T14:56:20.852 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-01T14:56:25.968 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-08-01T14:56:31.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:35.024 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-08-01T14:56:36.462 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-08-01T14:56:36.463 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-08-01T14:56:36.479 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2023-08-01T14:56:36.479 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2023-08-01T14:56:36.533 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-08-01T14:56:36.533 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-08-01T14:56:36.676 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2023-08-01T14:56:36.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-08-01T14:56:36.763 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2023-08-01T14:56:36.827 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-08-01T14:56:36.889 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-08-01T14:56:36.943 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T14:56:36.944 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T14:56:36.944 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-08-01T14:56:36.944 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-08-01T14:56:36.944 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-08-01T14:56:36.944 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T14:56:36.945 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-08-01T14:56:36.946 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T14:56:36.946 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T14:56:36.946 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T14:56:36.946 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T14:56:36.947 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-08-01T14:56:36.948 DEBUG:teuthology.parallel:result is None
2023-08-01T14:56:41.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:44.080 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-08-01T14:56:50.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:56:53.136 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2023-08-01T14:56:59.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:57:59.168 WARNING:teuthology.provision.fog.smithi018:timed out
2023-08-01T14:58:05.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:58:05.467 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-01T14:58:05.468 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-01T14:58:05.713 INFO:teuthology.provision.fog.smithi018:Node is ready
2023-08-01T14:58:05.713 DEBUG:teuthology.orchestra.run.smithi018:> hostname
2023-08-01T14:58:05.769 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2023-08-01T14:58:05.770 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts
2023-08-01T14:58:05.826 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2023-08-01T14:58:05.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2023-08-01T14:58:05.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts
2023-08-01T14:58:05.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts
2023-08-01T14:58:06.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname
2023-08-01T14:58:06.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2023-08-01T14:58:06.173 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2023-08-01T14:58:06.228 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T14:58:06.228 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T14:58:06.228 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.4"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2023-08-01T14:58:06.229 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T14:58:06.230 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T14:58:06.231 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T14:58:06.231 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2023-08-01T14:58:06.231 DEBUG:teuthology.parallel:result is None
2023-08-01T14:58:06.399 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2023-08-01T14:58:06.400 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-01T14:58:06.421 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-08-01T14:58:06.421 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-01T14:58:06.439 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2023-08-01T14:58:06.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2023-08-01T14:58:06.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:58:06.504 DEBUG:teuthology.orchestra.run.smithi018:> true
2023-08-01T14:58:06.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com'
2023-08-01T14:58:06.567 DEBUG:teuthology.orchestra.run.smithi018:> uname -m
2023-08-01T14:58:06.622 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2023-08-01T14:58:06.622 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2023-08-01T14:58:06.677 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T14:58:06.677 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.4"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2023-08-01T14:58:06.678 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T14:58:06.679 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T14:58:06.680 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2023-08-01T14:58:06.704 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-08-01T14:58:06.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-08-01T14:58:06.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T14:58:06.769 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-08-01T14:58:06.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-08-01T14:58:06.887 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-08-01T14:58:06.941 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-08-01T14:58:06.941 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-08-01T14:58:06.995 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T14:58:06.995 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T14:58:06.995 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-08-01T14:58:06.995 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-08-01T14:58:06.995 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T14:58:06.996 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T14:58:06.997 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-08-01T14:58:06.997 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T14:58:06.997 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T14:58:06.997 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T14:58:06.997 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T14:58:06.998 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-08-01T14:58:07.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T14:58:07.103 INFO:teuthology.dispatcher.supervisor:Running job 7357963
2023-08-01T14:58:07.104 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357963 --name yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357963/orig.config.yaml
2023-08-01T14:58:07.108 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357963
2023-08-01T14:58:07.109 INFO:teuthology.dispatcher.supervisor:Job PID: 10916
2023-08-01T14:58:07.109 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-01T15:00:07.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:02:07.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:04:07.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:06:07.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:08:07.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:10:08.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:12:08.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:14:08.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:16:08.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:18:08.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:20:08.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:22:08.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:24:09.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:26:09.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:28:09.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T15:28:09.349 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-01T15:28:09.437 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-01T15:28:09.437 INFO:teuthology.nuke:Checking targets against current locks
2023-08-01T15:28:09.476 DEBUG:teuthology.nuke:shortname: smithi018
2023-08-01T15:28:09.476 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-01T15:28:09.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 14:50:01.717871', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkp9Ym86OnxLUOD2AkwA9kQsS1mDabq24wzejSMpYwhij1AmOaY98AW/JDgXNbD6TfTpY8aNHcD5EAEoSNmywNJWP/1JaWVwdIEsfDxu84RQOMQMmLGaFr1ptpp5EpOgywVaEpIwT9ZPB7I2W2Ig+ktbjkKMHyOo/8bR+nfvRronUSUGr5+lCq3oRplUSHxef7vyylb74kNCHCbGC8797qmjWTBj1fjCAXGqpwmCfCOr3RzKrXNjAbfZcaD42cqVCPcBf8Crda/nW+MdAkPbZ3LhEM7orztpfzUtnP0SRG1o7XNCy65KsI2wjO84UtdTb9qWStjMU+flQPnh428G5fRB/UYhDli1p54if731zspX7B80wBfqsj602eFoGKcAmPmYdkj5Zc9WMQf4UfebN9kqsyEXVJNv0ppmbl9FlUIQZ1uPUGeOvdkjTMkPzGxfmXJCpZ7HlV7eLkhdCPTeeq2SreebG+6M8hZ3102TwMVRWf2nd+Kd6c84qF2AQhb60='}
2023-08-01T15:28:09.499 DEBUG:teuthology.nuke:shortname: smithi119
2023-08-01T15:28:09.500 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-01T15:28:09.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_14:46:15-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 14:50:01.719984', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZXPb/J/X8W8SP3g/4lGFjYpH1JbSOMhz4oYggUutRkjjiltJpp2KL6eJXzOYszzcMG7NjDMDwVIe74Df3C5DH6fRdSOEfaULY46d3fTVVjIRJq8rgXdfahnr6JiJhmmuGc0j+z20b7qPXOLt7L9Bk/mpId9Ivqwtn4L4sBP4H0/eAbD17MVFiEqbORVoVEcRYMtzAhQeh3QluUBJrMRTR7KZM/1w3aYRxlBG7DmG0qQneEmf9qXSOkG1tgQLj03qfnkBoFmucye/So7WOks0p0AVMOFZ1xc5Nnn/piNY/dt2sgVcqW9e9jtadONnEdK+Xs7JE9DgPxG8u4JY39WBS411+JxoSLUk2caRBoroxmYd6C2Eqcg+wticsN2C7h3VySdKyAc3uh/6E6Q8gEBFJbZVJxDFJJi0hyOBEtwcoDFgIY79Yu+yL2ohm2Q0WLDRQMUh7pUmiyw1Yyu1JOlL7z/SEu0y5iktWpJTmkcG+RMq4TrgPdCdLlUoEDfHccNM='}
2023-08-01T15:28:09.536 INFO:teuthology.orchestra.console.smithi018:Power off
2023-08-01T15:28:09.537 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T15:28:09.557 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2023-08-01T15:28:09.558 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T15:28:09.573 INFO:teuthology.orchestra.console.smithi119:Power off
2023-08-01T15:28:09.574 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T15:28:09.582 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2023-08-01T15:28:09.593 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-08-01T15:28:09.593 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T15:28:09.612 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-08-01T15:28:09.684 INFO:teuthology.orchestra.console.smithi018:Power off completed
2023-08-01T15:28:09.713 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-08-01T15:28:09.833 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com
2023-08-01T15:28:09.856 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com