2023-07-11T09:01:02.382 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T09:01:02.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:01:02.384 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:01:02.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdbe57705b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdbe50cb5e0>, signals=[15])
2023-07-11T09:01:02.566 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2023-07-11T09:01:02.566 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T09:01:02.566 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2023-07-11T09:01:02.587 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging
2023-07-11T09:01:02.587 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T09:01:02.587 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-07-11T09:01:02.589 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /host {"name": "smithi042"}
2023-07-11T09:01:08.786 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-07-11T09:01:08.786 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T09:01:08.787 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-07-11T09:01:08.788 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"}
2023-07-11T09:01:28.812 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"}
2023-07-11T09:01:28.846 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T09:01:33.833 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T09:01:33.834 DEBUG:teuthology.provision.fog.smithi042:FOG request: PUT /host/147 {"imageID": 3}
2023-07-11T09:01:43.876 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T09:01:48.883 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.stream
2023-07-11T09:01:48.883 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None
2023-07-11T09:01:48.885 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T09:01:48.945 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T09:01:48.945 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 3}
2023-07-11T09:01:48.948 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T09:01:48.949 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 3}
2023-07-11T09:01:48.992 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T09:01:49.003 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream
2023-07-11T09:01:49.003 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T09:01:49.007 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream
2023-07-11T09:01:49.007 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-07-11T09:01:49.031 DEBUG:teuthology.provision.fog.smithi042:FOG request: POST /host/147/task {"taskTypeID": 1}
2023-07-11T09:01:49.095 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T09:01:49.101 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T09:01:49.106 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None
2023-07-11T09:01:49.140 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1}
2023-07-11T09:01:49.146 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1}
2023-07-11T09:01:49.395 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T09:01:49.397 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-07-11T09:01:49.435 INFO:teuthology.orchestra.console:Power off smithi042
2023-07-11T09:01:49.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:01:49.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:49.506 INFO:teuthology.orchestra.console:Power off smithi167
2023-07-11T09:01:49.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:01:49.521 INFO:teuthology.orchestra.console:Power off smithi158
2023-07-11T09:01:49.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:01:49.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:49.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:49.584 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2023-07-11T09:01:49.655 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2023-07-11T09:01:49.666 INFO:teuthology.orchestra.console:Power off for smithi158 completed
2023-07-11T09:01:49.685 INFO:teuthology.orchestra.console:Power on smithi042
2023-07-11T09:01:49.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T09:01:49.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:49.756 INFO:teuthology.orchestra.console:Power on smithi167
2023-07-11T09:01:49.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T09:01:49.767 INFO:teuthology.orchestra.console:Power on smithi158
2023-07-11T09:01:49.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T09:01:49.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:49.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:53.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:53.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:53.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:58.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:58.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:01:58.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:03.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:04.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:04.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:09.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:09.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:09.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:14.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:14.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:14.257 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:14.392 INFO:teuthology.orchestra.console:Power on for smithi042 completed
2023-07-11T09:02:14.493 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2023-07-11T09:02:14.493 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None
2023-07-11T09:02:19.603 INFO:teuthology.orchestra.console:Power on for smithi158 completed
2023-07-11T09:02:19.704 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish
2023-07-11T09:02:19.705 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-07-11T09:02:24.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:29.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:34.584 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None
2023-07-11T09:02:39.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:39.822 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-07-11T09:02:44.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:02:44.913 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2023-07-11T09:02:45.014 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-07-11T09:02:45.014 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T09:02:54.696 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None
2023-07-11T09:02:59.703 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-07-11T09:03:00.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:03:00.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:03:03.248 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-07-11T09:03:05.112 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T09:03:10.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:03:15.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:03:18.192 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-07-11T09:03:24.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:03:46.901 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:03:46.902 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:03:47.231 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-07-11T09:03:47.231 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-07-11T09:03:47.248 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167
2023-07-11T09:03:47.249 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts
2023-07-11T09:03:47.306 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-07-11T09:03:47.306 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167 smithi167
2023-07-11T09:03:47.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-11T09:03:47.417 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts
2023-07-11T09:03:47.445 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-07-11T09:03:47.514 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname
2023-07-11T09:03:47.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-11T09:03:47.627 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-07-11T09:03:47.684 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2023-07-11T09:03:47.684 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8"
2023-07-11T09:03:47.684 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2023-07-11T09:03:47.684 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:03:47.684 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:03:47.685 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:03:47.686 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:03:47.686 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2023-07-11T09:03:47.687 DEBUG:teuthology.parallel:result is None
2023-07-11T09:04:00.196 WARNING:teuthology.provision.fog.smithi042:timed out
2023-07-11T09:04:06.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:04:11.486 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:04:11.486 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:04:11.798 INFO:teuthology.provision.fog.smithi042:Node is ready
2023-07-11T09:04:11.798 DEBUG:teuthology.orchestra.run.smithi042:> hostname
2023-07-11T09:04:11.819 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2023-07-11T09:04:11.820 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts
2023-07-11T09:04:11.882 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2023-07-11T09:04:11.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2023-07-11T09:04:12.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts
2023-07-11T09:04:12.049 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts
2023-07-11T09:04:12.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname
2023-07-11T09:04:12.198 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2023-07-11T09:04:12.270 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2023-07-11T09:04:12.332 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2023-07-11T09:04:12.333 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8"
2023-07-11T09:04:12.333 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2023-07-11T09:04:12.333 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:04:12.334 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8"
2023-07-11T09:04:12.334 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:04:12.334 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:04:12.335 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2023-07-11T09:04:12.335 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:04:12.335 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:04:12.335 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:04:12.336 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:04:12.336 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:04:12.337 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2023-07-11T09:04:12.337 DEBUG:teuthology.parallel:result is None
2023-07-11T09:04:29.216 WARNING:teuthology.provision.fog.smithi158:timed out
2023-07-11T09:04:35.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:04:40.559 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:04:40.559 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:04:40.846 INFO:teuthology.provision.fog.smithi158:Node is ready
2023-07-11T09:04:40.847 DEBUG:teuthology.orchestra.run.smithi158:> hostname
2023-07-11T09:04:40.864 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158
2023-07-11T09:04:40.865 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158 /etc/hosts
2023-07-11T09:04:40.922 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158
2023-07-11T09:04:40.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-07-11T09:04:41.041 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hosts
2023-07-11T09:04:41.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts
2023-07-11T09:04:41.138 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hostname
2023-07-11T09:04:41.223 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-07-11T09:04:41.294 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-07-11T09:04:41.354 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T09:04:41.355 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)"
2023-07-11T09:04:41.355 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel"
2023-07-11T09:04:41.356 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora"
2023-07-11T09:04:41.356 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6"
2023-07-11T09:04:41.356 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:04:41.357 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-11T09:04:41.357 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2023-07-11T09:04:41.357 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-11T09:04:41.358 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T09:04:41.358 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T09:04:41.358 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:04:41.359 INFO:teuthology.orchestra.run.smithi158.stdout:
2023-07-11T09:04:41.359 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:04:41.359 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-11T09:04:41.360 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T09:04:41.360 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-11T09:04:41.363 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi158's OS to be centos 8 but found rhel 8.6
2023-07-11T09:04:41.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:04:41.366 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:04:46.467 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T09:04:51.419 DEBUG:teuthology.nuke:shortname: smithi042
2023-07-11T09:04:51.420 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T09:04:51.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 09:01:01.501588', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIDold4jgWXgTOgzHabQDOJZTtth30UKHbicfaXEZK4yK8xkBkc8uuu/EPFyzXxWX17DnMaiVs0m5MRVHGcuiJHGpV/oY8j1y9f8UtqDRb4H2vya1kVf32l7Bl5vjYOs96O86R8FlD4h3xkyx3XsZhh3A5kmQlhFuaG9GxoQH+6O0DHB2hRDIJ9hrNQ7rR6oj37wMVbiJnqUAekwt1H1y+JkcGWrOk2P7bpxJ+C8L4V7g0xSqFd4BpyI3siGVrT5B/CHf0+I8NebIJKa3tEywTFdD8Odupw08kefR39cke4ouJSLWzPScPqpDv2aVmiSRqRNJxlAzDgbqTSDujkORb+10dQYrzbrTpgKZcWJvVVEJm6pHtUfqaGiQekdAvFQfSxWH913NG6OKNeiQlVSpoM1bJ1QQxE9el7qCbfV9uxcx0JNAxB6zjdFwtHldLkyuKGCWn1eS7jgXXI+8AqUqtv2edIs6ouThs33OiDeyII8D5sp9JCxweqLr6AGB/sTc='}
2023-07-11T09:04:51.451 DEBUG:teuthology.nuke:shortname: smithi158
2023-07-11T09:04:51.451 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T09:04:51.469 DEBUG:teuthology.nuke:shortname: smithi167
2023-07-11T09:04:51.470 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T09:04:51.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 09:01:01.502732', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-11T09:04:51.492 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 09:01:01.499773', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdQJ6h1BAZfISXzaACO0tBqLcGVl1srpiCpSrgbKo1i4ubcH+UfaFdH7VjBwEHzKc4gqRZ0lVr+GnnrWQaqJ3DNyGaD2A/f3fuCkuc5s+XNa0im31/zozHBvzd4k9fQNH4oL9Ea3RISO4MEc4iaYY/ArMTYMntuFdhmgZt5HIHIZU8Bo4WsskXUrLMGm6Ph+7AE7yGoBZ0bc7EB/U+dj3+7Ty3nOlgYpn0xrxUeT2ivcjtFpfLH/cw3RN7yOo79VvyzEkIgEzzvNIcYq2eeFH5gFN64wHQQIhMWtSsIoA9cDNBaq/B2tL8NDqHFb+ulsb89OtI6hHGRZ9jxvx0sQsUjJ7mQFZneJ52B6dpqar02XPJo09JDMHeJVN3rqPFockYVzWd8JGyarORhgf94EqkNRLylXD5NeEZRNsP3DxVzMq4P6vaANQnnYnOmPdvRR2kpe31KbITfciyN6hWqPcdOufpwD6REwuONl78v3Mo19lSDUzN8ALJBLzFwFoRuis='}
2023-07-11T09:04:51.518 INFO:teuthology.orchestra.console:Power off smithi042
2023-07-11T09:04:51.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:04:51.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:51.564 INFO:teuthology.orchestra.console:Power off smithi167
2023-07-11T09:04:51.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:04:51.585 INFO:teuthology.orchestra.console:Power off smithi158
2023-07-11T09:04:51.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:04:51.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:51.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:55.607 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:55.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:55.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:59.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:59.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:04:59.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:04.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:04.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:04.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:09.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:09.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:09.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:15.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:15.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:15.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:20.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:20.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:20.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:20.396 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2023-07-11T09:05:21.790 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com
2023-07-11T09:05:25.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:25.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:30.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:30.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:31.072 INFO:teuthology.orchestra.console:Power off for smithi158 completed
2023-07-11T09:05:41.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:41.254 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com
2023-07-11T09:05:46.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:05:46.534 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2023-07-11T09:05:56.704 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com
2023-07-11T09:06:12.135 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi158's OS to be centos 8 but found rhel 8.6