2023-07-05T15:09:21.596 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-05T15:09:21.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:09:21.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:09:21.765 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb624fed520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb6262078b0>, signals=[15])
2023-07-05T15:09:21.767 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2023-07-05T15:09:21.767 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2023-07-05T15:09:21.768 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-07-05T15:09:21.792 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2023-07-05T15:09:21.792 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2023-07-05T15:09:21.793 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2023-07-05T15:09:21.794 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"}
2023-07-05T15:09:21.817 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"}
2023-07-05T15:09:21.868 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-05T15:09:21.898 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-05T15:09:21.911 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-05T15:09:21.912 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 7}
2023-07-05T15:09:21.940 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-05T15:09:21.940 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 7}
2023-07-05T15:09:21.960 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4
2023-07-05T15:09:21.961 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:09:21.985 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.4
2023-07-05T15:09:21.985 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:09:22.017 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"}
2023-07-05T15:09:22.023 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"}
2023-07-05T15:09:22.052 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1}
2023-07-05T15:09:22.055 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1}
2023-07-05T15:09:22.112 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:09:22.121 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:09:22.210 INFO:teuthology.orchestra.console:Power off smithi083
2023-07-05T15:09:22.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T15:09:22.227 INFO:teuthology.orchestra.console:Power off smithi067
2023-07-05T15:09:22.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T15:09:22.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:22.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:26.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:26.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:30.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:30.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:30.603 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-07-05T15:09:30.704 INFO:teuthology.orchestra.console:Power on smithi067
2023-07-05T15:09:30.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-05T15:09:30.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:34.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:34.695 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2023-07-05T15:09:34.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:34.797 INFO:teuthology.orchestra.console:Power on smithi083
2023-07-05T15:09:34.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-05T15:09:34.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:38.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:38.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:09:39.057 INFO:teuthology.orchestra.console:Power on for smithi083 completed
2023-07-05T15:09:39.126 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2023-07-05T15:09:39.158 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2023-07-05T15:09:39.158 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:09:39.227 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2023-07-05T15:09:39.228 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:09:54.231 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:09:54.277 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:10:09.304 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:10:09.334 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:10:24.372 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:10:24.388 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:10:39.454 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:10:39.455 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:10:54.532 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:10:54.533 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:11:09.608 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:11:09.610 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:11:24.689 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:11:24.691 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:11:39.774 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:11:39.775 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:11:54.852 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:11:54.854 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:12:09.936 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:12:09.937 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:12:25.016 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-05T15:12:25.018 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-07-05T15:12:25.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:25.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:28.144 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:12:28.145 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:12:34.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:34.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:37.200 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:12:37.201 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:12:43.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:43.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:46.292 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:12:46.293 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:12:52.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:52.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:12:55.377 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:12:55.378 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:13:01.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:01.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:04.468 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:13:04.469 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:13:10.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:10.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:13.552 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:13:13.553 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:13:19.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:19.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:22.608 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-05T15:13:22.609 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-07-05T15:13:28.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:13:28.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:14:28.674 WARNING:teuthology.provision.fog.smithi067:timed out
2023-07-05T15:14:28.676 WARNING:teuthology.provision.fog.smithi083:timed out
2023-07-05T15:14:34.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:14:34.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:14:34.959 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-05T15:14:34.960 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-05T15:14:35.039 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-05T15:14:35.039 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-05T15:14:35.258 INFO:teuthology.provision.fog.smithi083:Node is ready
2023-07-05T15:14:35.259 DEBUG:teuthology.orchestra.run.smithi083:> hostname
2023-07-05T15:14:35.273 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2023-07-05T15:14:35.274 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts
2023-07-05T15:14:35.308 INFO:teuthology.provision.fog.smithi067:Node is ready
2023-07-05T15:14:35.309 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2023-07-05T15:14:35.325 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067
2023-07-05T15:14:35.325 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067 /etc/hosts
2023-07-05T15:14:35.327 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2023-07-05T15:14:35.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2023-07-05T15:14:35.381 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2023-07-05T15:14:35.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-07-05T15:14:35.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts
2023-07-05T15:14:35.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts
2023-07-05T15:14:35.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067/smithi067/g' /etc/hosts
2023-07-05T15:14:35.517 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2023-07-05T15:14:35.523 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname
2023-07-05T15:14:35.583 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067/smithi067/g' /etc/hostname
2023-07-05T15:14:35.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2023-07-05T15:14:35.649 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-07-05T15:14:35.650 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2023-07-05T15:14:35.703 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8"
2023-07-05T15:14:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T15:14:35.705 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-05T15:14:35.706 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-05T15:14:35.706 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-05T15:14:35.706 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2023-07-05T15:14:35.708 DEBUG:teuthology.parallel:result is None
2023-07-05T15:14:35.712 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-07-05T15:14:35.766 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2023-07-05T15:14:35.767 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)"
2023-07-05T15:14:35.767 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2023-07-05T15:14:35.767 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2023-07-05T15:14:35.767 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4"
2023-07-05T15:14:35.767 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T15:14:35.768 INFO:teuthology.orchestra.run.smithi067.stdout:
2023-07-05T15:14:35.769 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T15:14:35.769 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-05T15:14:35.769 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-05T15:14:35.769 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-05T15:14:35.769 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2023-07-05T15:14:35.770 DEBUG:teuthology.parallel:result is None
2023-07-05T15:14:35.916 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2023-07-05T15:14:35.917 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-05T15:14:35.939 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2023-07-05T15:14:35.940 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-05T15:14:35.966 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2023-07-05T15:14:35.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2023-07-05T15:14:35.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:14:36.036 DEBUG:teuthology.orchestra.run.smithi067:> true
2023-07-05T15:14:36.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com'
2023-07-05T15:14:36.098 DEBUG:teuthology.orchestra.run.smithi067:> uname -m
2023-07-05T15:14:36.152 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2023-07-05T15:14:36.153 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-07-05T15:14:36.207 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2023-07-05T15:14:36.207 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)"
2023-07-05T15:14:36.208 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2023-07-05T15:14:36.208 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2023-07-05T15:14:36.208 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4"
2023-07-05T15:14:36.208 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-07-05T15:14:36.208 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-05T15:14:36.209 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-07-05T15:14:36.209 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-05T15:14:36.209 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2023-07-05T15:14:36.210 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-05T15:14:36.210 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T15:14:36.210 INFO:teuthology.orchestra.run.smithi067.stdout:
2023-07-05T15:14:36.210 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T15:14:36.210 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-05T15:14:36.211 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-05T15:14:36.211 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-05T15:14:36.211 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-07-05T15:14:36.248 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2023-07-05T15:14:36.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-05T15:14:36.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T15:14:36.314 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-07-05T15:14:36.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-07-05T15:14:36.379 DEBUG:teuthology.orchestra.run.smithi083:> uname -m
2023-07-05T15:14:36.432 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2023-07-05T15:14:36.433 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2023-07-05T15:14:36.486 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux"
2023-07-05T15:14:36.486 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2023-07-05T15:14:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-05T15:14:36.488 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/"
2023-07-05T15:14:36.488 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-05T15:14:36.488 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T15:14:36.488 INFO:teuthology.orchestra.run.smithi083.stdout:
2023-07-05T15:14:36.488 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T15:14:36.489 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-05T15:14:36.489 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-05T15:14:36.489 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-05T15:14:36.490 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2023-07-05T15:14:36.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:14:36.516 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:14:36.608 INFO:teuthology.dispatcher.supervisor:Running job 7327270
2023-07-05T15:14:36.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi/7327270 --name adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi --description orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi/7327270/orig.config.yaml
2023-07-05T15:14:36.611 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi/7327270
2023-07-05T15:14:36.612 INFO:teuthology.dispatcher.supervisor:Job PID: 2819
2023-07-05T15:14:36.613 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-05T15:16:36.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:16:36.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:18:36.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:18:36.889 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:20:37.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:20:37.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:22:37.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:22:37.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:24:37.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:24:37.409 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:26:37.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:26:37.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:28:37.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:28:37.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:30:37.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T15:30:37.945 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T15:30:38.023 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-05T15:30:38.122 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-05T15:30:38.122 INFO:teuthology.nuke:Checking targets against current locks
2023-07-05T15:30:38.178 DEBUG:teuthology.nuke:shortname: smithi067
2023-07-05T15:30:38.179 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-05T15:30:38.204 DEBUG:teuthology.nuke:shortname: smithi083
2023-07-05T15:30:38.205 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-05T15:30:38.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi/7327270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 15:09:20.794615', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKwpya5/r7ShCMX58JCm676UlTBn417KYqwQ9LPA0QqVGX+LFWEZ3GEc8ahlR8uK5xWdDsWObCoqZhfpBWjFbnM='}
2023-07-05T15:30:38.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-05_14:40:06-orch:cephadm-wip-adk2-testing-2023-06-28-1402-pacific-distro-default-smithi/7327270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 15:09:20.793034', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2D6z4xBN4Fru5x8Eott/VNGd66LlKPN78IMBUDtBhwAlz7xuUErN/O7U03Dl4mcE+vphXI+W2F7vW5Cd5cMIywX1FpWsBqMMKgzwgq0El+LsRhqQT2ssK75jam7znReqxstM903PEM7ZXFsSfvSyINEYwsndR4PwngXBIebFMQ0wWqTV19wAWmYBcc/8QP1rYGtkCd9S6QMKkeDIAjc//DBL5rs85GFig+6rGDdZpoL1oGZ7lSPOpm2nXaCyiFUvLBVe1IygU7qPTyyfV/k2WgvwxxKPYQEAg65TTF4c3uOiv2TDw6OtTPM019JQiSB8b796oQuMMzU2ZWVpiA2YaJ3ohGDp7c96AbfWkc0BxpmaQZexsAjfZo73vhj/Do8j6EwJCjArxbtwNlrKPpPI1dKatwLPM9AQMsKh0AG8w3DWw53yWK9HY9wG+nR72iXg49ibzelM9DDeg3p9aAYV2Wx32BI/bz7nNKhjo76uvv6gCT5/TxM50mRQww83N1Ls='}
2023-07-05T15:30:38.261 INFO:teuthology.orchestra.console:Power off smithi067
2023-07-05T15:30:38.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T15:30:38.280 INFO:teuthology.orchestra.console:Power off smithi083
2023-07-05T15:30:38.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T15:30:38.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:30:38.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T15:30:38.420 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-07-05T15:30:38.434 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2023-07-05T15:30:38.576 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2023-07-05T15:30:38.585 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com