2023-07-08T00:22:34.222 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T00:22:34.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:22:34.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:22:34.377 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7994bc8b0>, signals=[15]) 2023-07-08T00:22:34.378 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-07-08T00:22:34.379 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:34.379 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-07-08T00:22:34.401 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-07-08T00:22:34.402 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:34.402 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-08T00:22:34.403 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /host {"name": "smithi078"} 2023-07-08T00:22:34.427 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-07-08T00:22:34.477 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-08T00:22:34.496 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-08T00:22:34.524 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-08T00:22:34.525 DEBUG:teuthology.provision.fog.smithi078:FOG request: PUT /host/183 {"imageID": 5} 2023-07-08T00:22:34.538 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-08T00:22:34.538 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 5} 2023-07-08T00:22:34.581 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2023-07-08T00:22:34.581 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:22:34.590 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2023-07-08T00:22:34.591 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:22:34.870 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:34.891 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:34.909 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-07-08T00:22:34.930 DEBUG:teuthology.provision.fog.smithi078:FOG request: POST /host/183/task {"taskTypeID": 1} 2023-07-08T00:22:34.968 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:22:34.989 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:22:35.247 INFO:teuthology.orchestra.console:Power off smithi078 2023-07-08T00:22:35.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:35.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:35.287 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-08T00:22:35.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:35.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:39.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:39.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:43.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:43.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:43.624 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-07-08T00:22:43.725 INFO:teuthology.orchestra.console:Power on smithi078 2023-07-08T00:22:43.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:43.745 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:47.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:47.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:47.774 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-08T00:22:47.875 INFO:teuthology.orchestra.console:Power on smithi086 2023-07-08T00:22:47.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:47.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:51.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:51.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:52.127 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2023-07-08T00:22:52.176 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2023-07-08T00:22:52.229 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-07-08T00:22:52.229 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:22:52.277 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-07-08T00:22:52.278 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:23:07.513 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:23:07.521 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:23:22.767 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:23:22.789 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:23:38.020 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:23:38.055 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:23:53.288 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:23:53.297 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:24:08.660 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:24:08.662 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:24:24.108 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:24:24.110 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:24:39.600 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:24:39.601 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:24:55.209 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:24:55.221 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:25:10.912 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:25:10.917 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:25:26.397 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:25:26.398 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:25:41.900 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:25:41.948 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:25:57.376 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:25:57.377 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:26:13.838 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:26:13.839 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:26:30.191 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:26:30.245 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:26:46.319 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:26:46.373 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:27:02.263 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-08T00:27:02.272 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:27:02.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:06.064 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:12.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:15.120 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:18.004 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:27:21.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:24.176 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:30.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:33.232 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:33.752 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:27:39.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:42.352 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:48.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:49.018 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:27:51.440 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-08T00:27:57.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:04.436 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:28:19.728 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:28:35.052 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:28:50.391 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:28:57.452 WARNING:teuthology.provision.fog.smithi086:timed out 2023-07-08T00:29:03.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:29:03.809 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:29:03.810 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:29:04.067 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-07-08T00:29:04.068 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-07-08T00:29:04.084 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 2023-07-08T00:29:04.085 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086 /etc/hosts 2023-07-08T00:29:04.142 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-07-08T00:29:04.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-08T00:29:04.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086/smithi086/g' /etc/hosts 2023-07-08T00:29:04.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-07-08T00:29:04.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086/smithi086/g' /etc/hostname 2023-07-08T00:29:04.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-08T00:29:04.469 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-08T00:29:04.525 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-08T00:29:04.525 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-08T00:29:04.526 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-08T00:29:04.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-08T00:29:04.528 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-07-08T00:29:04.529 DEBUG:teuthology.parallel:result is None 2023-07-08T00:29:05.723 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:29:21.080 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:29:36.436 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:29:51.752 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-08T00:29:52.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:29:55.088 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:01.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:04.176 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:10.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:13.232 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:19.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:22.292 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:28.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:31.376 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:37.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:40.432 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-08T00:30:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:31:46.490 WARNING:teuthology.provision.fog.smithi078:timed out 2023-07-08T00:31:52.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:31:52.845 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:31:52.845 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:31:53.124 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-07-08T00:31:53.125 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-07-08T00:31:53.144 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 2023-07-08T00:31:53.144 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078 /etc/hosts 2023-07-08T00:31:53.203 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-07-08T00:31:53.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-07-08T00:31:53.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hosts 2023-07-08T00:31:53.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-07-08T00:31:53.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hostname 2023-07-08T00:31:53.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-07-08T00:31:53.549 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-07-08T00:31:53.603 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-07-08T00:31:53.604 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-07-08T00:31:53.604 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-07-08T00:31:53.604 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-07-08T00:31:53.605 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-08T00:31:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-08T00:31:53.607 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-07-08T00:31:53.607 DEBUG:teuthology.parallel:result is None 2023-07-08T00:31:53.764 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-07-08T00:31:53.765 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:31:53.789 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-07-08T00:31:53.790 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:31:53.806 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:31:53.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-07-08T00:31:53.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:31:53.868 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-07-08T00:31:53.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-07-08T00:31:53.891 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-07-08T00:31:53.943 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-07-08T00:31:53.944 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-07-08T00:31:53.996 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:31:53.997 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-07-08T00:31:53.998 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:31:53.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-08T00:31:53.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-08T00:31:53.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-08T00:31:53.999 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-07-08T00:31:54.030 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:31:54.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-08T00:31:54.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:31:54.096 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-07-08T00:31:54.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-08T00:31:54.187 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-07-08T00:31:54.243 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-07-08T00:31:54.243 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-08T00:31:54.300 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-08T00:31:54.300 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-08T00:31:54.301 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-08T00:31:54.302 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-08T00:31:54.303 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-08T00:31:54.303 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-08T00:31:54.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:31:54.332 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:31:54.426 INFO:teuthology.dispatcher.supervisor:Running job 7328578 2023-07-08T00:31:54.427 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328578 --name adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi --description orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328578/orig.config.yaml 2023-07-08T00:31:54.431 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328578 2023-07-08T00:31:54.432 INFO:teuthology.dispatcher.supervisor:Job PID: 3791 2023-07-08T00:31:54.432 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T00:33:54.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:33:54.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:35:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:35:54.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:37:54.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:37:54.880 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:39:55.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:39:55.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:41:55.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:41:55.243 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:43:55.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:43:55.424 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:45:55.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:45:55.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:47:55.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:47:55.842 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:49:56.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:49:56.064 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:51:56.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:51:56.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:53:56.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:53:56.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:53:56.493 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T00:53:56.597 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T00:53:56.597 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T00:53:56.653 DEBUG:teuthology.nuke:shortname: smithi078 2023-07-08T00:53:56.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T00:53:56.680 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:33.358464', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-08T00:53:56.682 DEBUG:teuthology.nuke:shortname: smithi086 2023-07-08T00:53:56.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T00:53:56.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:33.360187', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-08T00:53:56.735 INFO:teuthology.orchestra.console:Power off smithi078 2023-07-08T00:53:56.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:53:56.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:53:56.780 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-08T00:53:56.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:53:56.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:53:56.891 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-07-08T00:53:56.925 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-08T00:53:57.059 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-07-08T00:53:57.082 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com