2023-06-21T01:51:48.215 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-21T01:51:48.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T01:51:48.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T01:51:48.497 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fba5b58f5e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fba5af2c430>, signals=[15])
2023-06-21T01:51:48.499 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-06-21T01:51:48.499 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T01:51:48.500 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-06-21T01:51:48.536 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-06-21T01:51:48.537 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T01:51:48.537 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-06-21T01:51:48.540 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"}
2023-06-21T01:51:48.581 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"}
2023-06-21T01:51:48.656 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-21T01:51:48.666 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-21T01:51:48.712 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-21T01:51:48.712 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 5}
2023-06-21T01:51:48.714 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-21T01:51:48.714 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5}
2023-06-21T01:51:48.764 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6
2023-06-21T01:51:48.765 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:51:48.775 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6
2023-06-21T01:51:48.775 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:51:48.832 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T01:51:48.836 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T01:51:48.900 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1}
2023-06-21T01:51:48.905 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1}
2023-06-21T01:51:49.054 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:51:49.055 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:51:49.190 INFO:teuthology.orchestra.console:Power off smithi088
2023-06-21T01:51:49.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T01:51:49.218 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-21T01:51:49.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T01:51:49.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:49.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:49.382 INFO:teuthology.orchestra.console:Power off for smithi088 completed
2023-06-21T01:51:49.392 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-21T01:51:49.484 INFO:teuthology.orchestra.console:Power on smithi088
2023-06-21T01:51:49.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T01:51:49.505 INFO:teuthology.orchestra.console:Power on smithi031
2023-06-21T01:51:49.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T01:51:49.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:49.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:53.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:53.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:51:53.802 INFO:teuthology.orchestra.console:Power on for smithi088 completed
2023-06-21T01:51:53.811 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-06-21T01:51:53.908 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-06-21T01:51:53.909 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:51:53.912 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-06-21T01:51:53.912 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:52:08.980 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:52:08.982 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:52:24.050 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:52:24.052 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:52:39.122 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:52:39.123 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:52:54.197 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:52:54.199 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:53:09.264 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:53:09.266 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:53:24.324 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:53:24.326 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:53:39.388 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:53:39.390 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:53:54.460 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:53:54.463 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:54:09.528 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:54:09.529 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:54:24.604 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:54:24.606 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-21T01:54:24.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:54:30.769 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-21T01:54:36.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:54:39.656 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:54:39.860 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-21T01:54:45.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:54:48.948 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-21T01:54:54.707 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-06-21T01:54:54.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:54:54.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:54:57.812 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:54:58.004 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-21T01:55:03.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:04.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:06.900 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:12.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:15.984 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:21.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:25.040 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:31.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:34.096 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:40.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:43.184 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:49.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:55:52.240 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:55:58.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:56:01.296 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-06-21T01:56:04.008 WARNING:teuthology.provision.fog.smithi031:timed out
2023-06-21T01:56:07.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:56:10.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:56:10.652 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-21T01:56:10.655 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-21T01:56:11.009 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-06-21T01:56:11.009 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2023-06-21T01:56:11.029 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2023-06-21T01:56:11.029 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2023-06-21T01:56:11.089 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2023-06-21T01:56:11.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-21T01:56:11.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2023-06-21T01:56:11.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2023-06-21T01:56:11.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2023-06-21T01:56:11.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-21T01:56:11.468 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-06-21T01:56:11.525 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-06-21T01:56:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2023-06-21T01:56:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-06-21T01:56:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-06-21T01:56:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2023-06-21T01:56:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T01:56:11.527 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-06-21T01:56:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T01:56:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-21T01:56:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-21T01:56:11.528 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-21T01:56:11.529 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2023-06-21T01:56:11.530 DEBUG:teuthology.parallel:result is None
2023-06-21T01:56:39.348 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-21T01:56:39.348 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-21T01:56:39.792 INFO:teuthology.provision.fog.smithi088:Node is ready
2023-06-21T01:56:39.793 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2023-06-21T01:56:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2023-06-21T01:56:39.809 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2023-06-21T01:56:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2023-06-21T01:56:39.866 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-06-21T01:56:40.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2023-06-21T01:56:40.073 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2023-06-21T01:56:40.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2023-06-21T01:56:40.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-06-21T01:56:40.272 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-06-21T01:56:40.328 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-06-21T01:56:40.328 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-06-21T01:56:40.328 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-06-21T01:56:40.328 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-21T01:56:40.329 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-21T01:56:40.330 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-21T01:56:40.331 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-21T01:56:40.331 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2023-06-21T01:56:40.331 DEBUG:teuthology.parallel:result is None
2023-06-21T01:56:40.489 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2023-06-21T01:56:40.489 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-21T01:56:40.514 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2023-06-21T01:56:40.515 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-21T01:56:40.542 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2023-06-21T01:56:40.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-06-21T01:56:40.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:56:40.611 DEBUG:teuthology.orchestra.run.smithi031:> true
2023-06-21T01:56:40.680 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2023-06-21T01:56:40.740 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2023-06-21T01:56:40.741 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-06-21T01:56:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-06-21T01:56:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2023-06-21T01:56:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-21T01:56:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-21T01:56:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-21T01:56:40.803 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-06-21T01:56:40.831 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2023-06-21T01:56:40.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-06-21T01:56:40.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T01:56:40.895 DEBUG:teuthology.orchestra.run.smithi088:> true
2023-06-21T01:56:40.918 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2023-06-21T01:56:40.975 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2023-06-21T01:56:40.975 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-06-21T01:56:41.030 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-06-21T01:56:41.031 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-06-21T01:56:41.031 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-06-21T01:56:41.031 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-21T01:56:41.032 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-06-21T01:56:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-21T01:56:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T01:56:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-06-21T01:56:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T01:56:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-21T01:56:41.034 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-21T01:56:41.034 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-21T01:56:41.034 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-06-21T01:56:41.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T01:56:41.056 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T01:56:41.159 INFO:teuthology.dispatcher.supervisor:Running job 7309346
2023-06-21T01:56:41.159 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309346 --name adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} -- /home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309346/orig.config.yaml
2023-06-21T01:56:41.163 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309346
2023-06-21T01:56:41.164 INFO:teuthology.dispatcher.supervisor:Job PID: 16904
2023-06-21T01:56:41.164 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-21T01:58:41.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T01:58:41.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T01:58:41.330 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-21T01:58:41.425 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi031 but it was locked by another job: /home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309351
2023-06-21T01:58:41.425 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-21T01:58:41.426 INFO:teuthology.nuke:Checking targets against current locks
2023-06-21T01:58:41.475 DEBUG:teuthology.nuke:shortname: smithi031
2023-06-21T01:58:41.475 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T01:58:41.497 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 01:57:49.325173', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-06-21T01:58:41.508 DEBUG:teuthology.nuke:shortname: smithi088
2023-06-21T01:58:41.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T01:58:41.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-21_01:27:59-orch:cephadm-wip-adk4-testing-2023-06-20-1932-distro-default-smithi/7309346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 01:51:45.381676', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-21T01:58:41.542 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-21T01:58:41.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T01:58:41.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:58:41.588 INFO:teuthology.orchestra.console:Power off smithi088
2023-06-21T01:58:41.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T01:58:41.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:58:41.730 INFO:teuthology.orchestra.console:Power off for smithi088 completed
2023-06-21T01:58:41.923 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-06-21T01:58:45.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T01:58:45.813 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-21T01:58:45.970 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com