2023-08-01T18:14:09.845 INFO:root:teuthology version: 0.0.1.dev174+g10753fd
2023-08-01T18:14:09.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:14:09.976 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa5dc34d7c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa5dc3cff70>, signals=[15])
2023-08-01T18:14:09.978 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-08-01T18:14:09.978 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-08-01T18:14:09.978 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-08-01T18:14:09.997 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-08-01T18:14:09.998 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-08-01T18:14:09.998 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-01T18:14:09.999 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"}
2023-08-01T18:14:10.022 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-08-01T18:14:10.068 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-01T18:14:10.086 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-01T18:14:10.108 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-01T18:14:10.109 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 7}
2023-08-01T18:14:10.127 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-01T18:14:10.128 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 7}
2023-08-01T18:14:10.157 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.4
2023-08-01T18:14:10.157 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:14:10.163 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.4
2023-08-01T18:14:10.163 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:14:10.257 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"}
2023-08-01T18:14:10.259 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-08-01T18:14:10.291 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-08-01T18:14:10.293 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1}
2023-08-01T18:14:10.350 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:14:10.354 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:14:10.459 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-01T18:14:10.460 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T18:14:10.473 INFO:teuthology.orchestra.console.smithi043:Power off
2023-08-01T18:14:10.474 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T18:14:10.486 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-08-01T18:14:10.487 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:10.496 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-08-01T18:14:10.497 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:10.506 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-01T18:14:10.516 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-08-01T18:14:10.607 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-01T18:14:10.617 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-08-01T18:14:10.708 INFO:teuthology.orchestra.console.smithi093:Power on
2023-08-01T18:14:10.709 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-01T18:14:10.718 INFO:teuthology.orchestra.console.smithi043:Power on
2023-08-01T18:14:10.718 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-01T18:14:10.731 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-08-01T18:14:10.732 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:10.741 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2023-08-01T18:14:10.742 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:10.753 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-01T18:14:10.763 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-08-01T18:14:14.756 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:14.764 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:14:14.866 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-08-01T18:14:14.874 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-08-01T18:14:14.967 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-08-01T18:14:14.976 INFO:teuthology.orchestra.console.smithi043:Power on completed
2023-08-01T18:14:15.068 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-08-01T18:14:15.069 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:14:15.077 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-08-01T18:14:15.077 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:14:30.178 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:14:30.184 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:14:45.298 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:14:45.299 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:15:00.400 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:15:00.402 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:15:15.518 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:15:15.519 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:15:50.154 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:15:50.155 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:16:05.322 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:16:05.323 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:16:20.479 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:16:20.491 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:16:35.656 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:16:35.658 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:16:50.839 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:16:50.841 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-08-01T18:16:51.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:06.028 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-01T18:17:06.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:09.488 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-08-01T18:17:15.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:18.544 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-08-01T18:17:24.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:24.592 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-01T18:17:27.632 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-08-01T18:17:30.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:33.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:33.648 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-01T18:17:36.688 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-08-01T18:17:39.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:42.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:42.704 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-01T18:17:48.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:17:51.760 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-01T18:17:57.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:18:42.731 WARNING:teuthology.provision.fog.smithi043:timed out
2023-08-01T18:18:48.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:18:49.022 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-01T18:18:49.023 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-01T18:18:49.283 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-08-01T18:18:49.284 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-08-01T18:18:49.299 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-08-01T18:18:49.299 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-08-01T18:18:49.354 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-08-01T18:18:49.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-08-01T18:18:49.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-08-01T18:18:49.493 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-08-01T18:18:49.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-08-01T18:18:49.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-08-01T18:18:49.685 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-08-01T18:18:49.739 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T18:18:49.739 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T18:18:49.739 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.4"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T18:18:49.740 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T18:18:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T18:18:49.742 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-08-01T18:18:49.780 DEBUG:teuthology.parallel:result is None
2023-08-01T18:18:57.777 WARNING:teuthology.provision.fog.smithi093:timed out
2023-08-01T18:19:03.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:19:04.123 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-01T18:19:04.124 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-01T18:19:04.418 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-08-01T18:19:04.418 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-08-01T18:19:04.434 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093
2023-08-01T18:19:04.434 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts
2023-08-01T18:19:04.490 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-08-01T18:19:04.490 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-01T18:19:04.603 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts
2023-08-01T18:19:04.631 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-08-01T18:19:04.698 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname
2023-08-01T18:19:04.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-01T18:19:04.828 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-01T18:19:04.882 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T18:19:04.882 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.4"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-01T18:19:04.883 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T18:19:04.884 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T18:19:04.885 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T18:19:04.885 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T18:19:04.885 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-08-01T18:19:04.886 DEBUG:teuthology.parallel:result is None
2023-08-01T18:19:05.021 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-08-01T18:19:05.022 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-01T18:19:05.050 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-08-01T18:19:05.051 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-01T18:19:05.068 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-08-01T18:19:05.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-08-01T18:19:05.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:19:05.137 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-08-01T18:19:05.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-08-01T18:19:05.259 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-08-01T18:19:05.315 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-08-01T18:19:05.315 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-08-01T18:19:05.369 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T18:19:05.369 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T18:19:05.369 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.4"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T18:19:05.370 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T18:19:05.371 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T18:19:05.372 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-08-01T18:19:05.400 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-08-01T18:19:05.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-01T18:19:05.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-01T18:19:05.464 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-08-01T18:19:05.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-01T18:19:05.532 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-08-01T18:19:05.586 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-08-01T18:19:05.587 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.4 (Ootpa)"
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.4"
2023-08-01T18:19:05.641 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-08-01T18:19:05.642 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-01T18:19:05.643 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-01T18:19:05.643 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-01T18:19:05.643 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-01T18:19:05.643 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-01T18:19:05.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:19:05.743 INFO:teuthology.dispatcher.supervisor:Running job 7357994
2023-08-01T18:19:05.744 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357994 --name yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357994/orig.config.yaml
2023-08-01T18:19:05.746 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357994
2023-08-01T18:19:05.747 INFO:teuthology.dispatcher.supervisor:Job PID: 1494
2023-08-01T18:19:05.747 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-01T18:21:05.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:23:06.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:25:06.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:27:06.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:29:06.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:31:08.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:33:09.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:35:09.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:37:09.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:39:09.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:41:09.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:43:09.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:45:10.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:47:10.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:49:10.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:51:10.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-01T18:51:10.598 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-01T18:51:10.696 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-01T18:51:10.696 INFO:teuthology.nuke:Checking targets against current locks
2023-08-01T18:51:10.749 DEBUG:teuthology.nuke:shortname: smithi043
2023-08-01T18:51:10.750 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-01T18:51:10.768 DEBUG:teuthology.nuke:shortname: smithi093
2023-08-01T18:51:10.768 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-01T18:51:10.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 18:14:09.057975', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGkPUIMQiNTXeRxDpmv1Fz+G3rVyHxtsEAjbXIIh+4G2jiNCTBfeo6+NXsQ0kzEm8QW2s/Snk4atWuatHPx8fAey7CaYJ0pgl4AvBO0k5ZvIWzrB74iLLBcvMBi+ZuIbKZmrAeSPP8623RPeM6uQjfYIK45BXGv/S37Z4pB+P1FD1u+bpkEl1Ze1kjHvXg9aCZKJ2EL80ThFpwLS76EeHRmnmYVMAzlsW7aD/o6tJzTLcP4VsvgCE2EJGJgiWs+vKFEJRjd+6Gkt+ZpevxYFumDa/Vvfvl6kq7Parik7rorxtOkl1Jr/xwsTZUWQ+X0B/gg37dQHI6pyFBlZZFH6wXglvGZrtl83F89LlJ0HSMAR/vlSM9laupcNtSlhi6CwyMofyb/4enENi1xo9QEa5LxYV+uk0a8EXWK+OK4GsGGBMe7eEIez5twtSu6OSCD4r22vo9evmw0O3g2cGxjHyaS3sw+m32gSSDF6ZFTokZll21MP2UHzFTSBNB4MF6bsk='}
2023-08-01T18:51:10.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_18:13:45-rgw-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7357994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 18:14:09.056265', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkNCyVl4UgLy/zi/dzr/kgZxW5o2MDYZksXmMyoEQ3MFcaClrW/a04zGJWwEixyznLvm0wfks1s6C0+mJm4+20='}
2023-08-01T18:51:10.821 INFO:teuthology.orchestra.console.smithi043:Power off
2023-08-01T18:51:10.822 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T18:51:10.834 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-01T18:51:10.835 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-01T18:51:10.843 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-08-01T18:51:10.844 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:51:10.854 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-08-01T18:51:10.854 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-01T18:51:10.862 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-08-01T18:51:10.873 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-01T18:51:10.963 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-08-01T18:51:10.974 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-01T18:51:11.105 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-08-01T18:51:11.122 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com